MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts.

Zhitian Xie, Yinger Zhang, Chenyi Zhuang, Qitao Shi, Zhining Liu, Jinjie Gu, Guannan Zhang

Browse the full AAAI paper archive.