LazyEviction: Lagged KV Eviction with Attention Pattern Observation for Efficient Long Reasoning.

Haoyue Zhang, Hualei Zhang, Xiaosong Ma, Jie Zhang, Song Guo

Browse the full ACL paper archive.