Attention Score is not All You Need for Token Importance Indicator in KV Cache Reduction: Value Also Matters.

Zhiyu Guo, Hidetaka Kamigaito, Taro Watanabe

Browse the full EMNLP paper archive.