On the weak link between importance and prunability of attention heads.

Aakriti Budhraja, Madhura Pande, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra

Browse the full EMNLP paper archive.