Attention Alignment and Flexible Positional Embeddings Improve Transformer Length Extrapolation.

Ta-Chung Chi, Ting-Han Fan, Alexander Rudnicky

Browse the full NAACL paper archive.