Transformers Provably Learn Sparse Token Selection While Fully-Connected Nets Cannot.

Zixuan Wang, Stanley Wei, Daniel Hsu, Jason D. Lee

Browse the full ICML paper archive.