Direction Matters: On the Implicit Bias of Stochastic Gradient Descent with Moderate Learning Rate.

Jingfeng Wu, Difan Zou, Vladimir Braverman, Quanquan Gu

Browse the full ICLR paper archive.