Quality over Quantity in Attention Layers: When Adding More Heads Hurts.

Noah Amsel, Gilad Yehudai, Joan Bruna

Browse the full ICLR paper archive.