FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models.

Xinglin Pan, Wenxiang Lin, Lin Zhang, Shaohuai Shi, Zhenheng Tang, Rui Wang, Bo Li, Xiaowen Chu

Browse the full ASPLOS paper archive.