Holmes: Localizing Irregularities in LLM Training with Mega-scale GPU Clusters.

Zhiyi Yao, Pengbo Hu, Congcong Miao, Xuya Jia, Zuning Liang, Yuedong Xu, Chunzhi He, Hao Lu, Mingzhuo Chen, Xiang Li, Zekun He, Yachen Wang, Xianneng Zou, Junchen Jiang

Browse the full NSDI paper archive.