The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training.

Fabian Schaipp, Alexander Hgele, Adrien B. Taylor, Umut Simsekli, Francis Bach

Browse the full ICML paper archive.