JanusQuant: Accurate and Efficient 2-bit KV Cache Quantization for Long-Context Inference.

Chengyu Sun, Yaqi Xia, Hulin Wang, Donglin Yang, Xiaobo Zhou, Dazhao Cheng

Browse the full PPoPP paper archive.