ServeGen: Workload Characterization and Generation of Large Language Model Serving in Production.

Yuxing Xiang, Xue Li, Kun Qian, Yan Zhang, Wenyuan Yu, Ennan Zhai, Xin Jin, Jingren Zhou

Browse the full NSDI paper archive.