HqeKV: Towards Hybrid Quantization and Eviction for KV Cache in Long-Context LLM Inference.

He Wang, Yu Gu, Fangfang Li, Zhigang Wang, Zhenghao Liu, Ning Wang, Xiaohua Li, Ge Yu

Browse the full ACL paper archive.