MLWQ: Efficient Small Language Model Deployment via Multi-Level Weight Quantization.

Chun Hu, Junhui He, Shangyu Wu, Yuxin He, Chun Jason Xue, Qingan Li

Browse the full EMNLP paper archive.