Optimizing Native Sparse Attention with Latent Attention and Local Global Alternating Strategies.

Yuxuan Hu, Jianchao Tan, Jiaqi Zhang, Wen Zan, Pingwei Sun, Yifan Lu, Xunliang Cai, Jing Zhang

Browse the full ACL paper archive.