DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving.

Yinmin Zhong, Shengyu Liu, Junda Chen, Jianbo Hu, Yibo Zhu, Xuanzhe Liu, Xin Jin, Hao Zhang

Browse the full OSDI paper archive.