How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese.

Takuro Fujii, Koki Shibata, Atsuki Yamaguchi, Terufumi Morishita, Yasuhiro Sogawa

Browse the full ACL paper archive.