Efficient LLM Inference on ARM via Hardware-Aware Operator Co-design and Heuristic Mixed-Precision Search.

Zhaode Wang, Jin Yao, Cheng Zhang, Shirui Zhao, Yong Wang, Xiaoxi Li, Xiguang Wu, Bo Li, Wei Mao, Yan Liu, Genquan Han

Browse the full ISCAS paper archive.