LSTM, GRU, Highway and a Bit of Attention: An Empirical Overview for Language Modeling in Speech Recognition.

Kazuki Irie, Zoltn Tske, Tamer Alkhouli, Ralf Schlter, Hermann Ney

Browse the full Interspeech paper archive.