Towards High-Goodput LLM Serving with Prefill-decode Multiplexing.

Yukang Chen, Weihao Cui, Han Zhao, Ziyi Xu, Xiaoze Fan, Xusheng Chen, Yangjie Zhou, Shixuan Sun, Bingsheng He, Quan Chen

Browse the full ASPLOS paper archive.