A Review of the Challenges with Massive Web-Mined Corpora Used in Large Language Models Pre-training.

Michal Perelkiewicz, Rafal Poswiata

Browse the full ICAISC paper archive.