TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning.

Yixuan Su, Fangyu Liu, Zaiqiao Meng, Tian Lan, Lei Shu, Ehsan Shareghi, Nigel Collier

Browse the full NAACL paper archive.