ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models.

Chenyang Song, Xu Han, Zhengyan Zhang, Shengding Hu, Xiyu Shi, Kuai Li, Chen Chen, Zhiyuan Liu, Guangli Li, Tao Yang, Maosong Sun

Browse the full COLING paper archive.