KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache.

Zirui Liu, Jiayi Yuan, Hongye Jin, Shaochen (Henry) Zhong, Zhaozhuo Xu, Vladimir Braverman, Beidi Chen, Xia Hu

Browse the full ICML paper archive.