Which transformer architecture fits my data? A vocabulary bottleneck in self-attention.

Noam Wies, Yoav Levine, Daniel Jannai, Amnon Shashua

Browse the full ICML paper archive.