Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation.

Zhewei Yao, Xiaoxia Wu, Cheng Li, Stephen Youn, Yuxiong He

Browse the full AAAI paper archive.