LocMoE: A Low-overhead MoE for Large Language Model Training.

Jing Li, Zhijie Sun, Xuan He, Li Zeng, Yi Lin, Entong Li, Binfan Zheng, Rongqian Zhao, Xin Chen

Browse the full IJCAI paper archive.