GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model.

Yingying Gao, Shilei Zhang, Chao Deng, Junlan Feng

Browse the full Interspeech paper archive.