Do Diacritics Matter? Evaluating the Impact of Arabic Diacritics on Tokenization and LLM Benchmarks.

Go Inoue, Bashar Alhafni, Nizar Habash, Timothy Baldwin

Browse the full EACL paper archive.