DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks.

Ziyang Luo, Yadong Xi, Jing Ma, Zhiwei Yang, Xiaoxi Mao, Changjie Fan, Rongsheng Zhang

Browse the full NAACL paper archive.