OOQ: Outlier-Oriented Quantization for Efficient Large Language Models.
Haoyu Wang, Bei Liu, Hang Shao, Bo Xiao, Ke Zeng, Guanglu Wan, Yanmin Qian
Browse the full ASRU paper archive.
Haoyu Wang, Bei Liu, Hang Shao, Bo Xiao, Ke Zeng, Guanglu Wan, Yanmin Qian
Browse the full ASRU paper archive.