CateKV: On Sequential Consistency for Long-Context LLM Inference Acceleration.

Haoyun Jiang, Haolin Li, Jianwei Zhang, Fei Huang, Qiang Hu, Minmin Sun, Shuai Xiao, Yong Li, Junyang Lin, Jiangchao Yao

Browse the full ICML paper archive.