An Optimization Pass for Training Speed-Up and Strategy Search in 3D Parallelism.

Ryubu Hosoki, Kento Sato, Toshio Endo, Julien Bigot, Edouard Audit

Browse the full CLUSTER paper archive.