Composite Slice Transformer: An Efficient Transformer with Composition of Multi-Scale Multi-Range Attentions.

Mingu Lee, Saurabh Pitre, Tianyu Jiang, Pierre-David Letourneau, Matthew J. Morse, Kanghwan Jang, Joseph Soriaga, Parham Noorzad, Hsin-Pai Cheng, Christopher Lott

Browse the full ICLR paper archive.