SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inference.

Jintao Zhang, Chendong Xiang, Haofeng Huang, Jia Wei, Haocheng Xi, Jun Zhu, Jianfei Chen

Browse the full ICML paper archive.