BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training.

Pavel Chizhov, Catherine Arnett, Elizaveta Korotkova, Ivan P. Yamshchikov

Browse the full EMNLP paper archive.