| 2024 | ICML | AST-T5: Structure-Aware Pretraining for Code Generation and Understanding. | Linyuan Gong, Mostafa Elhoushi, Alvin Cheung |
| 2024 | ICML | Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks. | Linyuan Gong, Sida Wang, Mostafa Elhoushi, Alvin Cheung |
| 2024 | IJCAI | ADELT: Transpilation between Deep Learning Frameworks. | Linyuan Gong, Jiayi Wang, Alvin Cheung |
| 2023 | ACL | Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers. | Linyuan Gong, Chenyan Xiong, Xiaodong Liu, Payal Bajaj, Yiqing Xie, Alvin Cheung, Jianfeng Gao, Xia Song |
| 2022 | COLING | Joint Language Semantic and Structure Embedding for Knowledge Graph Completion. | Jianhao Shen, Chenguang Wang, Linyuan Gong, Dawn Song |
| 2021 | ACL | PlotCoder: Hierarchical Decoding for Synthesizing Visualization Code in Programmatic Context. | Xinyun Chen, Linyuan Gong, Alvin Cheung, Dawn Song |
| 2021 | ICLR | Anytime Sampling for Autoregressive Models via Ordered Autoencoding. | Yilun Xu, Yang Song, Sahaj Garg, Linyuan Gong, Rui Shu, Aditya Grover, Stefano Ermon |
| 2019 | ICML | Efficient Training of BERT by Progressively Stacking. | Linyuan Gong, Di He, Zhuohan Li, Tao Qin, Liwei Wang, Tie-Yan Liu |