Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation.

Minglun Han, Feilong Chen, Jing Shi, Shuang Xu, Bo Xu

Browse the full Interspeech paper archive.