Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization.

Ermo Hua, Che Jiang, Xingtai Lv, Kaiyan Zhang, Youbang Sun, Yuchen Fan, Xuekai Zhu, Biqing Qi, Ning Ding, Bowen Zhou

Browse the full ICML paper archive.