NASPipe: high performance and reproducible pipeline parallel supernet training via causal synchronous parallelism.
Shixiong Zhao, Fanxin Li, Xusheng Chen, Tianxiang Shen, Li Chen, Sen Wang, Nicholas Zhang, Cheng Li, Heming Cui
Browse the full ASPLOS paper archive.