Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models.

Ze-Feng Gao, Peiyu Liu, Wayne Xin Zhao, Zhong-Yi Lu, Ji-Rong Wen

Browse the full COLING paper archive.