Residual Matrix Transformers: Scaling the Size of the Residual Stream.

Brian Mak, Jeffrey Flanigan

Browse the full ICML paper archive.