UPServe: Backend Agnostic Proxy for Black-box Heterogeneous LLM Scheduling.

Haorui Wan, Chenyang Hei, Fuliang Li, Chengxi Gao, Yuhan Jia, Tongrui Liu, Xingwei Wang

Browse the full IWQoS paper archive.