KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inference.

Yuxuan Tian, Zihan Wang, Yebo Peng, Aomufei Yuan, Zhiming Wang, Bairen Yi, Xin Liu, Yong Cui, Tong Yang

Browse the full AAAI paper archive.