MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards.

Sheng Wang, Liheng Chen, Pengan Chen, Jingwei Dong, Boyang Xue, Jiyue Jiang, Lingpeng Kong, Chuan Wu

Browse the full ICLR paper archive.