Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compression.

Peiyu Liu, Ze-Feng Gao, Xin Zhao, Yipeng Ma, Tao Wang, Ji-Rong Wen

Browse the full ACL paper archive.