RazorAttention: Efficient KV Cache Compression Through Retrieval Heads.

Hanlin Tang, Yang Lin, Jing Lin, Qingsen Han, Danning Ke, Shikuan Hong, Yiwu Yao, Gongyi Wang

Browse the full ICLR paper archive.