Making Every Head Count: Sparse Attention Without the Speed-Performance Trade-off.

Mingkuan Zhao, Wentao Hu, Jiayin Wang, Xin Lai, Tianchen Huang, Yuheng Min, Rui Yan, Xiaoyan Zhu

Browse the full AAAI paper archive.