MoLA: MoE LoRA with Layer-wise Expert Allocation.

Chongyang Gao, Kezhen Chen, Jinmeng Rao, Ruibo Liu, Baochen Sun, Yawen Zhang, Daiyi Peng, Xiaoyuan Guo, V. S. Subrahmanian

Browse the full NAACL paper archive.