A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules.

Kairong Luo, Haodong Wen, Shengding Hu, Zhenbo Sun, Zhiyuan Liu, Maosong Sun, Kaifeng Lyu, Wenguang Chen

Browse the full ICLR paper archive.