Towards Efficient Compound Large Language Model System Serving in the Wild.

Yifei Zhu, Botao Zhu, Chen Chen, Xiaoyi Fan

Browse the full IWQoS paper archive.