MILLION: MasterIng Long-Context LLM Inference Via Outlier-Immunized KV Product QuaNtization.

Zongwu Wang, Peng Xu, Fangxin Liu, Yiwei Hu, Qingxiao Sun, Gezi Li, Cheng Li, Xuan Wang, Li Jiang, Haibing Guan

Browse the full DAC paper archive.