Don't Use Large Mini-batches, Use Local SGD.

Tao Lin, Sebastian U. Stich, Kumar Kshitij Patel, Martin Jaggi

Browse the full ICLR paper archive.