| 2022 | ICLR | SimVLM: Simple Visual Language Model Pretraining with Weak Supervision. | Zirui Wang, Jiahui Yu, Adams Wei Yu, Zihang Dai, Yulia Tsvetkov, Yuan Cao |
| 2022 | ICML | Transformer Quality in Linear Time. | Weizhe Hua, Zihang Dai, Hanxiao Liu, Quoc V. Le |
| 2021 | CVPR | Meta Pseudo Labels. | Hieu Pham, Zihang Dai, Qizhe Xie, Quoc V. Le |
| 2020 | ICLR | A Mutual Information Maximization Perspective of Language Representation Learning. | Lingpeng Kong, Cyprien de Masson d'Autume, Lei Yu, Wang Ling, Zihang Dai, Dani Yogatama |
| 2020 | LREC | Wiki-40B: Multilingual Language Model Dataset. | Mandy Guo, Zihang Dai, Denny Vrandecic, Rami Al-Rfou |
| 2019 | AAAI | Fast and Simple Mixture of Softmaxes with BPE and Hybrid-LightRNN for Language Generation. | Xiang Kong, Qizhe Xie, Zihang Dai, Eduard H. Hovy |
| 2019 | ACL | Transformer-XL: Attentive Language Models beyond a Fixed-Length Context. | Zihang Dai, Zhilin Yang, Yiming Yang, Jaime G. Carbonell, Quoc Viet Le, Ruslan Salakhutdinov |
| 2019 | CVPR | Characterizing and Avoiding Negative Transfer. | Zirui Wang, Zihang Dai, Barnabs Pczos, Jaime G. Carbonell |
| 2018 | ACL | From Credit Assignment to Entropy Regularization: Two New Algorithms for Neural Sequence Prediction. | Zihang Dai, Qizhe Xie, Eduard H. Hovy |
| 2018 | EMNLP | SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine Translation. | Xinyi Wang, Hieu Pham, Zihang Dai, Graham Neubig |
| 2018 | EMNLP | Large-scale Cloze Test Dataset Created by Teachers. | Qizhe Xie, Guokun Lai, Zihang Dai, Eduard H. Hovy |
| 2018 | ICLR | Breaking the Softmax Bottleneck: A High-Rank RNN Language Model. | Zhilin Yang, Zihang Dai, Ruslan Salakhutdinov, William W. Cohen |
| 2017 | ACL | An Interpretable Knowledge Transfer Model for Knowledge Base Completion. | Qizhe Xie, Xuezhe Ma, Zihang Dai, Eduard H. Hovy |
| 2017 | ICLR | Calibrating Energy-based Generative Adversarial Networks. | Zihang Dai, Amjad Almahairi, Philip Bachman, Eduard H. Hovy, Aaron C. Courville |
| 2016 | ACL | CFO: Conditional Focused Neural Question Answering with Large-scale Knowledge Bases. | Zihang Dai, Lei Li, Wei Xu |