Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-task Learning.

Ziyu Zhao, Yixiao Zhou, Xin Yu, Zhi Zhang, Didi Zhu, Tao Shen, Zexi Li, Jinluan Yang, Xuwu Wang, Jing Su, Kun Kuang, Zhongyu Wei, Fei Wu, Yu Cheng

Browse the full KDD paper archive.