| 2025 | EMNLP | SWAN: An Efficient and Scalable Approach for Long-Context Language Modeling. | Krishna C. Puvvada, Faisal Ladhak, Santiago Akle Serano, Cheng-Ping Hsieh, Shantanu Acharya, Somshubra Majumdar, Fei Jia, Samuel Kriman, Simeng Sun, Dima Rekesh, Boris Ginsburg |
| 2025 | ICLR | nGPT: Normalized Transformer with Representation Learning on the Hypersphere. | Ilya Loshchilov, Cheng-Ping Hsieh, Simeng Sun, Boris Ginsburg |
| 2025 | NAACL | How much do contextualized representations encode long-range context? | Simeng Sun, Cheng-Ping Hsieh |
| 2024 | EACL | How Does In-Context Learning Help Prompt Tuning? | Simeng Sun, Yang Liu, Dan Iter, Chenguang Zhu, Mohit Iyyer |
| 2024 | EACL | PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents. | Simeng Sun, Yang Liu, Shuohang Wang, Dan Iter, Chenguang Zhu, Mohit Iyyer |
| 2024 | EMNLP | Suri: Multi-constraint Instruction Following in Long-form Text Generation. | Chau Pham, Simeng Sun, Mohit Iyyer |
| 2024 | NAACL | TopicGPT: A Prompt-based Topic Modeling Framework. | Chau Pham, Alexander Miserlis Hoyle, Simeng Sun, Philip Resnik, Mohit Iyyer |
| 2023 | EACL | Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages. | Simeng Sun, Maha Elbayad, Anna Y. Sun, James Cross |
| 2022 | ACL | Alternative Input Signals Ease Transfer in Multilingual Machine Translation. | Simeng Sun, Angela Fan, James Cross, Vishrav Chaudhary, Chau Tran, Philipp Koehn, Francisco Guzmn |
| 2022 | ECCV | Image Coding for Machines with Omnipotent Feature Learning. | Ruoyu Feng, Xin Jin, Zongyu Guo, Runsen Feng, Yixin Gao, Tianyu He, Zhizheng Zhang, Simeng Sun, Zhibo Chen |
| 2022 | NAACL | ChapterBreak: A Challenge Dataset for Long-Range Language Models. | Simeng Sun, Katherine Thai, Mohit Iyyer |
| 2021 | AAAI | Learning Omni-Frequency Region-adaptive Representations for Real Image Super-Resolution. | Xin Li, Xin Jin, Tao Yu, Simeng Sun, Yingxue Pang, Zhizheng Zhang, Zhibo Chen |
| 2021 | ACL | Energy-Based Reranking: Improving Neural Machine Translation Using Energy-Based Models. | Sumanta Bhattacharyya, Amirmohammad Rooshenas, Subhajit Naskar, Simeng Sun, Mohit Iyyer, Andrew McCallum |
| 2021 | EMNLP | Do Long-Range Language Models Actually Use Long-Range Context? | Simeng Sun, Kalpesh Krishna, Andrew Mattarella-Micke, Mohit Iyyer |
| 2021 | EMNLP | IGA: An Intent-Guided Authoring Assistant. | Simeng Sun, Wenlong Zhao, Varun Manjunatha, Rajiv Jain, Vlad I. Morariu, Franck Dernoncourt, Balaji Vasan Srinivasan, Mohit Iyyer |
| 2021 | NAACL | Revisiting Simple Neural Probabilistic Language Models. | Simeng Sun, Mohit Iyyer |
| 2020 | ACL | Hard-Coded Gaussian Attention for Neural Machine Translation. | Weiqiu You, Simeng Sun, Mohit Iyyer |
| 2020 | CVPR | Multi-scale Grouped Dense Network for VVC Intra Coding. | Xin Li, Simeng Sun, Zhizheng Zhang, Zhibo Chen |
| 2019 | EMNLP | The Feasibility of Embedding Based Automatic Evaluation for Single Document Summarization. | Simeng Sun, Ani Nenkova |
| 2019 | PCS | Beyond Coding: Detection-driven Image Compression with Semantically Structured Bit-stream. | Tianyu He, Simeng Sun, Zongyu Guo, Zhibo Chen |