The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles.

Md. Shamim Hussain, Mohammed J. Zaki, Dharmashankar Subramanian

Browse the full KDD paper archive.