Mixed INT4-INT8 LLM Quantization via Progressive Layerwise Assignment with Dynamic Sensitivity Estimation.

Jihoon Kim, Minseok Seo, Xuan Truong Nguyen

Browse the full ISCAS paper archive.