Maximizing Intermediate Checkpoint Value in LLM Pretraining with Bayesian Optimization.

Deyuan Liu, Zecheng Wang, Bingning Wang, Weipeng Chen, Chunshan Li, Zhiying Tu, Dianhui Chu, Dianbo Sui

Browse the full ICML paper archive.