Upcycling Instruction Tuning from Dense to Mixture-of-Experts via Parameter Merging.

Tingfeng Hui, Zhenyu Zhang, Shuohuan Wang, Yu Sun, Hua Wu, Sen Su

Browse the full ACL paper archive.