SWAN: An Efficient and Scalable Approach for Long-Context Language Modeling.

Krishna C. Puvvada, Faisal Ladhak, Santiago Akle Serano, Cheng-Ping Hsieh, Shantanu Acharya, Somshubra Majumdar, Fei Jia, Samuel Kriman, Simeng Sun, Dima Rekesh, Boris Ginsburg

Browse the full EMNLP paper archive.