Crypto-LLM: Two-Stage Language Model Pre-training with Ciphered and Natural Language Data.

Yohei Kobashi, Fumiya Uchiyama, Takeshi Kojima, Andrew Gambardella, Qi Cao, Yusuke Iwasawa, Yutaka Matsuo

Browse the full IJCNLP paper archive.