A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts.

Mohammed Nowaz Rabbani Chowdhury, Meng Wang, Kaoutar El Maghraoui, Naigang Wang, Pin-Yu Chen, Christopher D. Carothers

Browse the full ICML paper archive.