Comet: Accelerating Private Inference for Large Language Model by Predicting Activation Sparsity.

Guang Yan, Yuhui Zhang, Zimu Guo, Lutan Zhao, Xiaojun Chen, Chen Wang, Wenhao Wang, Dan Meng, Rui Hou

Browse the full SP paper archive.