Learning Dynamics in Continual Pre-Training for Large Language Models.

Xingjin Wang, Howe Tissue, Lu Wang, Linjing Li, Daniel Dajun Zeng

Browse the full ICML paper archive.