A Tabular Schedule Abstraction for Communication-Aware Evaluation of Pipeline-Parallel LLM Training.

Daniel Barley, Jonathan Leis, Benjamin Klenk, Holger Frning

Browse the full ISPDC paper archive.