OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization.

Cong Guo, Jiaming Tang, Weiming Hu, Jingwen Leng, Chen Zhang, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu

Browse the full ISCA paper archive.