TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models.

Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica

Browse the full ICML paper archive.