Combatting Dimensional Collapse in LLM Pre-Training Data via Submodular File Selection.

Ziqing Fan, Siyuan Du, Shengchao Hu, Pingjie Wang, Li Shen, Ya Zhang, Dacheng Tao, Yanfeng Wang

Browse the full ICLR paper archive.