On the token distance modeling ability of higher RoPE attention dimension.

Xiangyu Hong, Che Jiang, Biqing Qi, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou

Browse the full EMNLP paper archive.