Inconsistent Tokenizations Cause Language Models to be Perplexed by Japanese Grammar.

Andrew Gambardella, Takeshi Kojima, Yusuke Iwasawa, Yutaka Matsuo

Browse the full ACL paper archive.