SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator.

Guoxuan Chen, Han Shi, Jiawei Li, Yihang Gao, Xiaozhe Ren, Yimeng Chen, Xin Jiang, Zhenguo Li, Weiyang Liu, Chao Huang

Browse the full ICML paper archive.