Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention.

Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong

Browse the full ICML paper archive.