ThinK: Thinner Key Cache by Query-Driven Pruning.

Yuhui Xu, Zhanming Jie, Hanze Dong, Lei Wang, Xudong Lu, Aojun Zhou, Amrita Saha, Caiming Xiong, Doyen Sahoo

Browse the full ICLR paper archive.