Sparsing Law: Towards Large Language Models with Greater Activation Sparsity.

Yuqi Luo, Chenyang Song, Xu Han, Yingfa Chen, Chaojun Xiao, Xiaojun Meng, Liqun Deng, Jiansheng Wei, Zhiyuan Liu, Maosong Sun

Browse the full ICML paper archive.