XQuant: Achieving Ultra-Low Bit KV Cache Quantization with Cross-Layer Compression.

Haoqi Yang, Yao Yao, Zuchao Li, Baoyuan Qi, Guoming Liu, Hai Zhao

Browse the full EMNLP paper archive.