Lookahead Q-Cache: Achieving More Consistent KV Cache Eviction via Pseudo Query.

Yixuan Wang, Shiyu Ji, Yijun Liu, Yuzhuang Xu, Yang Xu, Qingfu Zhu, Wanxiang Che

Browse the full EMNLP paper archive.