Optimal Learning Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay (Extended Abstract).

Binghui Li, Zilin Wang, Fengling Chen, Shiyang Zhao, Ruiheng Zheng, Lei Wu

Browse the full COLT paper archive.