FlashMask: Efficient and Rich Mask Extension of FlashAttention.

Guoxia Wang, Jinle Zeng, Xiyuan Xiao, Siming Wu, Jiabin Yang, Lujing Zheng, Zeyu Chen, Jiang Bian, Dianhai Yu, Haifeng Wang

Browse the full ICLR paper archive.