PEPE: Long-context Extension for Large Language Models via Periodic Extrapolation Positional Encodings.

Jikun Hu, Dongsheng Guo, Yuli Liu, Qingyao Ai, Lixuan Wang, Xuebing Sun, Qilei Zhang, Quan Zhou, Cheng Luo

Browse the full EMNLP paper archive.