LongRoPE2: Near-Lossless LLM Context Window Scaling.

Ning Shang, Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang

Browse the full ICML paper archive.