WeiPipe: Weight Pipeline Parallelism for Communication-Effective Long-Context Large Model Training.

Junfeng Lin, Ziming Liu, Yang You, Jun Wang, Weihao Zhang, Rong Zhao

Browse the full PPoPP paper archive.