From 128K to 4M: Efficient Training of Ultra-Long Context Large Language Models.

Chejian Xu, Wei Ping, Peng Xu, Zihan Liu, Boxin Wang, Mohammad Shoeybi, Bo Li, Bryan Catanzaro

Browse the full ACL paper archive.