AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights.

Byeongho Heo, Sanghyuk Chun, Seong Joon Oh, Dongyoon Han, Sangdoo Yun, Gyuwan Kim, Youngjung Uh, Jung-Woo Ha

Browse the full ICLR paper archive.