XY-Serve: End-to-End Versatile Production Serving for Dynamic LLM Workloads.

Mingcong Song, Xinru Tang, Fengfan Hou, Jing Li, Wei Wei, Yipeng Ma, Runqiu Xiao, Hongjie Si, Dingcheng Jiang, Shouyi Yin, Yang Hu, Guoping Long

Browse the full ASPLOS paper archive.