Self-Indexing KVCache: Predicting Sparse Attention from Compressed Keys.

Xu Yang, Jiapeng Zhang, Dongyang Zhao, Guo Chen, Zhuo Tang

Browse the full AAAI paper archive.