Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encoding.

Liang Zhao, Xiachong Feng, Xiaocheng Feng, Weihong Zhong, Dongliang Xu, Qing Yang, Hongtao Liu, Bing Qin, Ting Liu

Browse the full EMNLP paper archive.