Cambricon-LLM: A Chiplet-Based Hybrid Architecture for On-Device Inference of 70B LLM.

Zhongkai Yu, Shengwen Liang, Tianyun Ma, Yunke Cai, Ziyuan Nan, Di Huang, Xinkai Song, Yifan Hao, Jie Zhang, Tian Zhi, Yongwei Zhao, Zidong Du, Xing Hu, Qi Guo, Tianshi Chen

Browse the full MICRO paper archive.