Attention layers provably solve single-location regression.

Pierre Marion, Raphal Berthier, Grard Biau, Claire Boyer

Browse the full ICLR paper archive.