Distilhubert: Speech Representation Learning by Layer-Wise Distillation of Hidden-Unit Bert.

Heng-Jui Chang, Shu-Wen Yang, Hung-yi Lee

Browse the full ICASSP paper archive.