AsymKV: Enabling 1-Bit Quantization of KV Cache with Layer-Wise Asymmetric Quantization Configurations.

Qian Tao, Wenyuan Yu, Jingren Zhou

Browse the full COLING paper archive.