Mixture of Heterogeneous Grouped Experts for Language Modeling.

Zhicheng Ma, Xiang Liu, Zhaoxiang Liu, Ning Wang, Yi Shen, Kai Wang, Shuming Shi, Shiguo Lian

Browse the full ACL paper archive.