A Transformer-Block-Wise Collaborative Training Mechanism with Hybrid Parallelism Over Heterogeneous Networks.

Jiewei Chen, Jingrong Wang, Shaoyong Guo, Jiakai Hao, Xuesong Qiu, Zehui Xiong

Browse the full WCNC paper archive.