Distillation Dynamics: Towards Understanding Feature-Based Distillation in Vision Transformers.

Huiyuan Tian, Bonan Xu, Shijian Li

Browse the full AAAI paper archive.