Accelerating Design Space Exploration for LLM Training Systems with Multi-experiment Parallel Simulation.

Fei Gui, Kaihui Gao, Li Chen, Dan Li, Vincent Liu, Ran Zhang, Hongbing Yang, Dian Xiong

Browse the full NSDI paper archive.