A Modular Analysis of Provable Acceleration via Polyak's Momentum: Training a Wide ReLU Network and a Deep Linear Network.

Jun-Kun Wang, Chi-Heng Lin, Jacob D. Abernethy

Browse the full ICML paper archive.