SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers.
Zicong Tang, Luohe Shi, Zuchao Li, Baoyuan Qi, Guoming Liu, Lefei Zhang, Ping Wang
Browse the full ACL paper archive.
Zicong Tang, Luohe Shi, Zuchao Li, Baoyuan Qi, Guoming Liu, Lefei Zhang, Ping Wang
Browse the full ACL paper archive.