Gradient correlation is a key ingredient to accelerate SGD with momentum.

Julien Hermant, Marien Renaud, Jean-Franois Aujol, Charles Dossal, Aude Rondepierre

Browse the full ICLR paper archive.