CAKE: Cascading and Adaptive KV Cache Eviction with Layer Preferences.

Ziran Qin, Yuchen Cao, Mingbao Lin, Wen Hu, Shixuan Fan, Ke Cheng, Weiyao Lin, Jianguo Li

Browse the full ICLR paper archive.