Are Pretrained Convolutions Better than Pretrained Transformers?

Yi Tay, Mostafa Dehghani, Jai Prakash Gupta, Vamsi Aribandi, Dara Bahri, Zhen Qin, Donald Metzler

Browse the full ACL paper archive.