GANQ: GPU-Adaptive Non-Uniform Quantization for Large Language Models.

Pengxiang Zhao, Xiaoming Yuan

Browse the full ICML paper archive.