Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum.

Zeke Xie, Xinrui Wang, Huishuai Zhang, Issei Sato, Masashi Sugiyama

Browse the full ICML paper archive.