Customizing the Inductive Biases of Softmax Attention using Structured Matrices.

Yilun Kuang, Noah Amsel, Sanae Lotfi, Shikai Qiu, Andres Potapczynski, Andrew Gordon Wilson

Browse the full ICML paper archive.