Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning.

Ted Zadouri, Ahmet stn, Arash Ahmadian, Beyza Ermis, Acyr Locatelli, Sara Hooker

Browse the full ICLR paper archive.