SmartMoE: Efficiently Training Sparsely-Activated Models through Combining Offline and Online Parallelization.

Mingshu Zhai, Jiaao He, Zixuan Ma, Zan Zong, Runqing Zhang, Jidong Zhai

Browse the full USENIX paper archive.