CMR Scaling Law: Predicting Critical Mixture Ratios for Continual Pre-training of Language Models.

Jiawei Gu, Zacc Yang, Chuanghao Ding, Rui Zhao, Fei Tan

Browse the full EMNLP paper archive.