Mitigating Frequency Bias and Anisotropy in Language Model Pre-Training with Syntactic Smoothing.

Richard Diehl Martinez, Zbulon Goriely, Andrew Caines, Paula Buttery, Lisa Beinborn

Browse the full EMNLP paper archive.