An Optimization Technique for Hiding Communication Costs in 3D Parallel Training of Deep Learning.

Ryubu Hosoki, Kento Sato, Toshio Endo, Julien Bigot, Edouard Audit

Browse the full CCGRID paper archive.