Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling.

Keyu Tian, Yi Jiang, Qishuai Diao, Chen Lin, Liwei Wang, Zehuan Yuan

Browse the full ICLR paper archive.