Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging.

Lujun Li, Qiyuan Zhu, Jiacheng Wang, Xiaoyu Qin, Wei Li, Hao Gu, Sirui Han, Yike Guo

Browse the full AAAI paper archive.