BlendServe: Optimizing Offline Inference with Resource-Aware Batching.

Yilong Zhao, Shuo Yang, Kan Zhu, Lianmin Zheng, Baris Kasikci, Yifan Qiao, Yang Zhou, Jiarong Xing, Ion Stoica

Browse the full ASPLOS paper archive.