Beyond Text Compression: Evaluating Tokenizers Across Scales.

Jonas F. Lotz, Antnio Vilarinho Lopes, Stephan Peitz, Hendra Setiawan, Leonardo Emili

Browse the full ACL paper archive.