WindServe: Efficient Phase-Disaggregated LLM Serving with Stream-based Dynamic Scheduling.

Jingqi Feng, Yukai Huang, Rui Zhang, Sicheng Liang, Ming Yan, Jie Wu

Browse the full ISCA paper archive.