Understanding the Difficulty of Low-Precision Post-Training Quantization for LLMs.

Zifei Xu, Sayeh Sharify, Wanzin Yazar, Tristan Webb, Xin Wang

Browse the full IJCNN paper archive.