A Mixture of h - 1 Heads is Better than h Heads.

Hao Peng, Roy Schwartz, Dianqi Li, Noah A. Smith

Browse the full ACL paper archive.