Mixture of Modular Experts: Distilling Knowledge from a Multilingual Teacher into Specialized Modular Language Models.

Mohammed Al-Maamari, Mehdi Ben Amor, Jelena Mitrovic, Michael Granitzer

Browse the full SAC paper archive.