DeepSpeed: System Optimizations Enable Training Deep Learning Models with Over 100 Billion Parameters.

Jeff Rasley, Samyam Rajbhandari, Olatunji Ruwase, Yuxiong He

Browse the full KDD paper archive.