Don't Jump Through Hoops and Remove Those Loops: SVRG and Katyusha are Better Without the Outer Loop.

Dmitry Kovalev, Samuel Horvth, Peter Richtrik

Browse the full ALT paper archive.