Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset.

Dan Su, Kezhi Kong, Ying Lin, Joseph Jennings, Brandon Norick, Markus Kliegl, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro

Browse the full ACL paper archive.