Automatic Expert Discovery in LLM Upcycling via Sparse Interpolated Mixture-of-Experts.

Shengzhuang Chen, Ying Wei, Jonathan Richard Schwarz

Browse the full ACL paper archive.