SparK: Query-Aware Unstructured Sparsity with Recoverable KV Cache Channel Pruning.

Huanxuan Liao, Yixing Xu, Shizhu He, Guanchen Li, Xuanwu Yin, Dong Li, Emad Barsoum, Jun Zhao, Kang Liu

Browse the full AAAI paper archive.