What Makes Quantization for Large Language Model Hard? An Empirical Study from the Lens of Perturbation.

Zhuocheng Gong, Jiahao Liu, Jingang Wang, Xunliang Cai, Dongyan Zhao, Rui Yan

Browse the full AAAI paper archive.