DeepCrossAttention: Supercharging Transformer Residual Connections.

Mike Heddes, Adel Javanmard, Kyriakos Axiotis, Gang Fu, MohammadHossein Bateni, Vahab Mirrokni

Browse the full ICML paper archive.