LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure.

Jaehong Cho, Hyunmin Choi, Guseul Heo, Jongse Park

Browse the full ISPASS paper archive.