Understanding Scalability and Fine-Grain Parallelism of Synchronous Data Parallel Training.

Jiali Li, Bogdan Nicolae, Justin M. Wozniak, George Bosilca

Browse the full SC paper archive.