Exploring and Mitigating Failure Behavior of Large Language Model Training Workloads in HPC Systems.

Pengfei Yu, Jingjing Gu, Hao Han, Dazhong Shen, Bao Wen, Yang Liu

Browse the full SC paper archive.