Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs.

Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao

Browse the full ICLR paper archive.