ShadowLLM: Resource-Efficient Hot Standby for Heterogeneous Edge LLM Serving.

Zhenguo Chen, Pujun Ding, Yuanwei Zhu, Hao Zhang, Jing Lv, Yakun Huang, Xiuquan Qiao

Browse the full ICDCS paper archive.