Accurate KV Cache Quantization with Outlier Tokens Tracing.

Yi Su, Yuechi Zhou, Quantong Qiu, Juntao Li, Qingrong Xia, Ping Li, Xinyu Duan, Zhefeng Wang, Min Zhang

Browse the full ACL paper archive.