LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens.

Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang

Browse the full ICML paper archive.