KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding.
Luohe Shi, Zuchao Li, Lefei Zhang, Baoyuan Qi, Guoming Liu, Hai Zhao
Browse the full ACL paper archive.
Luohe Shi, Zuchao Li, Lefei Zhang, Baoyuan Qi, Guoming Liu, Hai Zhao
Browse the full ACL paper archive.