You Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Sampling.

Zhanpeng Zeng, Yunyang Xiong, Sathya N. Ravi, Shailesh Acharya, Glenn Moo Fung, Vikas Singh

Browse the full ICML paper archive.