SwiftEP: Accelerating MoE Inference with Buffer Fusion and TMA Offloading.

Xingyi Li, Yadong Liu, Xiaojie Huang, Yiran Zhang, Shuai Wang, Shangguang Wang, Zhehao Lin, Yinben Xia, Chang Yu, Qihang Liu, Xuan Zhang, Hao Lu, Xiang Li, Zekun He, Yachen Wang, Xianneng Zou

Browse the full NSDI paper archive.