Perplexity-Aware Data Scaling Law: Perplexity Landscapes Predict Performance for Continual Pre-training.

Lei Liu, Hao Zhu, Xiaoyan Yang, Yue Shen, Zhixuan Chu, Jian Wang, Jinjie Gu, Kui Ren

Browse the full ACL paper archive.