A Formal Framework for Understanding Length Generalization in Transformers.

Xinting Huang, Andy Yang, Satwik Bhattamishra, Yash Raj Sarrof, Andreas Krebs, Hattie Zhou, Preetum Nakkiran, Michael Hahn

Browse the full ICLR paper archive.