GREYHOUND: Hunting Fail-Slows in Hybrid-Parallel Training at Scale.

Tianyuan Wu, Wei Wang, Yinghao Yu, Siran Yang, Wenchao Wu, Qinkai Duan, Guodong Yang, Jiamang Wang, Lin Qu, Liping Zhang

Browse the full USENIX paper archive.