MoE-SVD: Structured Mixture-of-Experts LLMs Compression via Singular Value Decomposition.

Wei Li, Lujun Li, Hao Gu, You-Liang Huang, Mark G. Lee, Shengjie Sun, Wei Xue, Yike Guo

Browse the full ICML paper archive.