Poolingformer: Long Document Modeling with Pooling Attention.

Hang Zhang, Yeyun Gong, Yelong Shen, Weisheng Li, Jiancheng Lv, Nan Duan, Weizhu Chen

Browse the full ICML paper archive.