From Averaging to Acceleration, There is Only a Step-size.

Nicolas Flammarion, Francis R. Bach

Browse the full COLT paper archive.