Semantics-Aware Scheduling for Low-Latency LLM Serving in Heterogeneous Computing Networks.
Rui Wang, Xingyan Chen, Yu Zhao, Mu Wang, Changqiao Xu
Browse the full IWCMC paper archive.
Rui Wang, Xingyan Chen, Yu Zhao, Mu Wang, Changqiao Xu
Browse the full IWCMC paper archive.