Counting in Small Transformers: The Delicate Interplay between Attention and Feed-Forward Layers.

Freya Behrens, Luca Biggio, Lenka Zdeborov

Browse the full ICML paper archive.