vTrain: A Simulation Framework for Evaluating Cost-Effective and Compute-Optimal Large Language Model Training.

Jehyeon Bang, Yujeong Choi, Myeongwoo Kim, Yongdeok Kim, Minsoo Rhu

Browse the full MICRO paper archive.