Fast On-device LLM Inference with NPUs.

Daliang Xu, Hao Zhang, Liming Yang, Ruiqi Liu, Gang Huang, Mengwei Xu, Xuanzhe Liu

Browse the full ASPLOS paper archive.