More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression.

Jiebin Zhang, Dawei Zhu, Yifan Song, Wenhao Wu, Chuqiao Kuang, Xiaoguang Li, Lifeng Shang, Qun Liu, Sujian Li

Browse the full EMNLP paper archive.