ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration.

Mengting Ai, Tianxin Wei, Yifan Chen, Zhichen Zeng, Ritchie Zhao, Girish Varatkar, Bita Darvish Rouhani, Xianfeng Tang, Hanghang Tong, Jingrui He

Browse the full KDD paper archive.