Metadata Conditioning Accelerates Language Model Pre-training.

Tianyu Gao, Alexander Wettig, Luxi He, Yihe Dong, Sadhika Malladi, Danqi Chen

Browse the full ICML paper archive.