An Integer-only Quantization Framework for Edge Deployment of Large Language Models.

Yaqi Hu, Zhuqing Yuan, Weichen Gao, Sheng Zhang, Yongpan Liu

Browse the full ISCAS paper archive.