Efficient Large-Scale Audio Tagging Via Transformer-to-CNN Knowledge Distillation.

Florian Schmid, Khaled Koutini, Gerhard Widmer

Browse the full ICASSP paper archive.