Low-Rank Decomposition Assisted Quantization and Inference Compensation for Quality Large Language Model Inference.

Jie Ou, Jinyu Guo, Shuaihong Jiang, Zhaokun Wang, Yueming Chen, Ruini Xue, Wenhong Tian

Browse the full IJCNN paper archive.