Recycle-and-Distill: Universal Compression Strategy for Transformer-based Speech SSL Models with Attention Map Reusing and Masking Distillation.

Kangwook Jang, Sungnyun Kim, Se-Young Yun, Hoirin Kim

Browse the full Interspeech paper archive.