Dynamic Masking Rate Schedules for MLM Pretraining.

Zachary Ankner, Naomi Saphra, Davis W. Blalock, Jonathan Frankle, Matthew L. Leavitt

Browse the full EACL paper archive.