Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer.
Kaiqi Zhao, Hieu Nguyen, Animesh Jain, Nathan Susanj, Athanasios Mouchtaris, Lokesh Gupta, Ming Zhao
Browse the full Interspeech paper archive.