Pre-training a BERT with Curriculum Learning by Increasing Block-Size of Input Text.

Koichi Nagatsuka, Clifford Broni-Bediako, Masayasu Atsumi

Browse the full RANLP paper archive.