Token Statistics Transformer: Linear-Time Attention via Variational Rate Reduction.

Ziyang Wu, Tianjiao Ding, Yifu Lu, Druv Pai, Jingyuan Zhang, Weida Wang, Yaodong Yu, Yi Ma, Benjamin David Haeffele

Browse the full ICLR paper archive.