RegMix: Data Mixture as Regression for Language Model Pre-training.

Qian Liu, Xiaosen Zheng, Niklas Muennighoff, Guangtao Zeng, Longxu Dou, Tianyu Pang, Jing Jiang, Min Lin

Browse the full ICLR paper archive.