TPLA: Tensor Parallel Latent Attention for Efficient Disaggregated Prefill & Decode Inference.

Xiaojuan Tang, Fanxu Meng, Pingzhi Tang, Yuxuan Wang, Di Yin, Xing Sun, Muhan Zhang

Browse the full ASPLOS paper archive.