Balanced Knowledge Distillation for Large Language Models with Mix-of-Experts.

Jiajun Liu, Yao He, Wenjun Ke, Peng Wang, Ziyu Shang, Guozheng Li, Zijie Xu

Browse the full AAAI paper archive.