Transformers are Multi-State RNNs.

Matanel Oren, Michael Hassid, Yarden Nir, Yossi Adi, Roy Schwartz

Browse the full EMNLP paper archive.