Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference.

Sneha Kudugunta, Yanping Huang, Ankur Bapna, Maxim Krikun, Dmitry Lepikhin, Minh-Thang Luong, Orhan Firat

Browse the full EMNLP paper archive.