SkyWalker: A Locality-Aware Cross-Region Load Balancer for LLM Inference.

Tian Xia, Ziming Mao, Jamison Kerney, Ethan J. Jackson, Zhifei Li, Jiarong Xing, Scott Shenker, Ion Stoica

Browse the full EuroSys paper archive.