On the utility of enhancing BERT syntactic bias with Token Reordering Pretraining.

Yassir El Mesbahi, Atif Mahmud, Abbas Ghaddar, Mehdi Rezagholizadeh, Philippe Langlais, Prasanna Parthasarathi

Browse the full CoNLL paper archive.