Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge.

Xuan Shen, Peiyan Dong, Lei Lu, Zhenglun Kong, Zhengang Li, Ming Lin, Chao Wu, Yanzhi Wang

Browse the full AAAI paper archive.