OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models.

Fuzhao Xue, Zian Zheng, Yao Fu, Jinjie Ni, Zangwei Zheng, Wangchunshu Zhou, Yang You

Browse the full ICML paper archive.