SP-MoE: Expediting Mixture-of-Experts Training with Optimized Pipelining Planning.

Ne Wang, Wenxiang Lin, Lin Zhang, Shaohuai Shi, Ruiting Zhou, Bo Li

Browse the full INFOCOM paper archive.