Distill Vision Transformers to CNNs via Teacher Collaboration.

Sunqi Lin, Chong Wang, Yujie Zheng, Chenchen Tao, Xinmiao Dai, Yuqi Li

Browse the full ICASSP paper archive.