FlashAttention-T: Towards Fully Tensorized Attention by Exploiting Tensor-Vector Parallelism.

Jianxing Xu, Yuanbo Wen, Jun Bi, Ruibai Xu, Guanglin Xu, Rui Zhang, Wei Li, Ling Li, Tianshi Chen, Qi Guo, Yunji Chen

Browse the full PPoPP paper archive.