LAVa: Layer-wise KV Cache Eviction with Dynamic Budget Allocation.

Yiqun Shen, Song Yuan, Zhengze Zhang, Xiaoliang Wang, Daxin Jiang, Cam-Tu Nguyen

Browse the full EMNLP paper archive.