PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers.

Xiaoyi Dong, Jianmin Bao, Ting Zhang, Dongdong Chen, Weiming Zhang, Lu Yuan, Dong Chen, Fang Wen, Nenghai Yu, Baining Guo

Browse the full AAAI paper archive.