No Head Left Behind - Multi-Head Alignment Distillation for Transformers.

Tianyang Zhao, Kunwar Yashraj Singh, Srikar Appalaraju, Peng Tang, Vijay Mahadevan, R. Manmatha, Ying Nian Wu

Browse the full AAAI paper archive.