Rethinking Channel Dimensions to Isolate Outliers for Low-bit Weight Quantization of Large Language Models.

Jung Hwan Heo, Jeonghoon Kim, Beomseok Kwon, Byeongwook Kim, Se Jung Kwon, Dongsoo Lee

Browse the full ICLR paper archive.