VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models.

Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang

Browse the full EMNLP paper archive.