SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization.

Jintao Zhang, Haofeng Huang, Pengle Zhang, Jia Wei, Jun Zhu, Jianfei Chen

Browse the full ICML paper archive.