Occult: Optimizing Collaborative Communications across Experts for Accelerated Parallel MoE Training and Inference.

Shuqing Luo, Pingzhi Li, Jie Peng, Yang Zhao, Yu Cao, Yu Cheng, Tianlong Chen

Browse the full ICML paper archive.