On the Generalization Ability of Next-Token-Prediction Pretraining.

Zhihao Li, Xue Jiang, Liyuan Liu, Xuelin Zhang, Hong Chen, Feng Zheng

Browse the full ICML paper archive.