Transformers Can Represent n-gram Language Models.

Anej Svete, Ryan Cotterell

Browse the full NAACL paper archive.