Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective.

Meizhi Zhong, Chen Zhang, Yikun Lei, Xikai Liu, Yan Gao, Yao Hu, Kehai Chen, Min Zhang

Browse the full COLING paper archive.