IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact.

Ruikang Liu, Haoli Bai, Haokun Lin, Yuening Li, Han Gao, Zhengzhuo Xu, Lu Hou, Jun Yao, Chun Yuan

Browse the full ACL paper archive.