POSPAN: Position-Constrained Span Masking for Language Model Pre-training.

Zhenyu Zhang, Lei Shen, Yuming Zhao, Meng Chen, Xiaodong He

Browse the full CIKM paper archive.