Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability.

Ivan Lee, Nan Jiang, Taylor Berg-Kirkpatrick

Browse the full ICLR paper archive.