The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs.

Piotr Nawrot, Jianing Li, Renjie Huang, Sebastian Ruder, Kelly Marchisio, Edoardo M. Ponti

Browse the full ACL paper archive.