RNNs are not Transformers (Yet): The Key Bottleneck on In-Context Retrieval.

Kaiyue Wen, Xingyu Dang, Kaifeng Lyu

Browse the full ICLR paper archive.