| 2025 | ACL | Bitnet.cpp: Efficient Edge Inference for Ternary LLMs. | Jinheng Wang, Hansong Zhou, Ting Song, Shijie Cao, Yan Xia, Ting Cao, Jianyu Wei, Shuming Ma, Hongyu Wang, Furu Wei |
| 2024 | ICLR | Grounding Multimodal Large Language Models to the World. | Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, Qixiang Ye, Furu Wei |
| 2024 | IROS | KOSMOS-E : Learning to Follow Instruction for Robotic Grasping. | Zhi Wang, Xun Wu, Shaohan Huang, Li Dong, Wenhui Wang, Shuming Ma, Furu Wei |
| 2023 | ACL | On the Off-Target Problem of Zero-Shot Multilingual Neural Machine Translation. | Liang Chen, Shuming Ma, Dongdong Zhang, Furu Wei, Baobao Chang |
| 2023 | ACL | Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers. | Damai Dai, Yutao Sun, Li Dong, Yaru Hao, Shuming Ma, Zhifang Sui, Furu Wei |
| 2023 | ACL | Discourse-Centric Evaluation of Document-level Machine Translation with a New Densely Annotated Parallel Corpus of Novels. | Yuchen Eleanor Jiang, Tianyu Liu, Shuming Ma, Dongdong Zhang, Mrinmaya Sachan, Ryan Cotterell |
| 2023 | ACL | A Length-Extrapolatable Transformer. | Yutao Sun, Li Dong, Barun Patra, Shuming Ma, Shaohan Huang, Alon Benhaim, Vishrav Chaudhary, Xia Song, Furu Wei |
| 2023 | ACL | GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator. | Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Furu Wei, Zhoujun Li |
| 2023 | DASFAA | HanoiT: Enhancing Context-aware Translation via Selective Context. | Jian Yang, Yuwei Yin, Shuming Ma, Liqun Yang, Hongcheng Guo, Haoyang Huang, Dongdong Zhang, Yutao Zeng, Zhoujun Li, Furu Wei |
| 2023 | EMNLP | TRIP: Accelerating Document-level Multilingual Pre-training via Triangular Document-level Pre-training on Parallel Data Triplets. | Hongyuan Lu, Haoyang Huang, Shuming Ma, Dongdong Zhang, Wai Lam, Zhaochuan Gao, Anthony Aue, Arul Menezes, Furu Wei |
| 2023 | ICLR | Are More Layers Beneficial to Graph Transformers? | Haiteng Zhao, Shuming Ma, Dongdong Zhang, Zhi-Hong Deng, Furu Wei |
| 2023 | ICML | Magneto: A Foundation Transformer. | Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei |
| 2022 | ACL | Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation. | Guanhua Chen, Shuming Ma, Yun Chen, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei |
| 2022 | ACL | XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. | Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Bo Zheng, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei |
| 2022 | ACL | StableMoE: Stable Routing Strategy for Mixture of Experts. | Damai Dai, Li Dong, Shuming Ma, Bo Zheng, Zhifang Sui, Baobao Chang, Furu Wei |
| 2022 | COLING | PAEG: Phrase-level Adversarial Example Generation for Neural Machine Translation. | Juncheng Wan, Jian Yang, Shuming Ma, Dongdong Zhang, Weinan Zhang, Yong Yu, Zhoujun Li |
| 2022 | EMNLP | Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt. | Lianzhe Huang, Shuming Ma, Dongdong Zhang, Furu Wei, Houfeng Wang |
| 2022 | EMNLP | CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation. | Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei |
| 2022 | IJCAI | A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model. | Xin Sun, Tao Ge, Shuming Ma, Jingjing Li, Furu Wei, Houfeng Wang |
| 2022 | IJCAI | High-resource Language-specific Training for Multilingual Neural Machine Translation. | Jian Yang, Yuwei Yin, Shuming Ma, Dongdong Zhang, Zhoujun Li, Furu Wei |
| 2022 | IJCAI | UM4: Unified Multilingual Multiple Teacher-Student Model for Zero-Resource Neural Machine Translation. | Jian Yang, Yuwei Yin, Shuming Ma, Dongdong Zhang, Shuangzhi Wu, Hongcheng Guo, Zhoujun Li, Furu Wei |
| 2022 | NAACL | BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation. | Yuchen Jiang, Tianyu Liu, Shuming Ma, Dongdong Zhang, Jian Yang, Haoyang Huang, Rico Sennrich, Ryan Cotterell, Mrinmaya Sachan, Ming Zhou |
| 2021 | ACL | How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation? | Weijia Xu, Shuming Ma, Dongdong Zhang, Marine Carpuat |
| 2021 | ACL | Multilingual Agreement for Multilingual Neural Machine Translation. | Jian Yang, Yuwei Yin, Shuming Ma, Haoyang Huang, Dongdong Zhang, Zhoujun Li, Furu Wei |
| 2021 | EMNLP | Zero-Shot Cross-Lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders. | Guanhua Chen, Shuming Ma, Yun Chen, Li Dong, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei |
| 2021 | EMNLP | mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. | Zewen Chi, Li Dong, Shuming Ma, Shaohan Huang, Saksham Singhal, Xian-Ling Mao, Heyan Huang, Xia Song, Furu Wei |
| 2021 | EMNLP | Improving Multilingual Neural Machine Translation with Auxiliary Source Languages. | Weijia Xu, Yuwei Yin, Shuming Ma, Dongdong Zhang, Haoyang Huang |
| 2021 | NAACL | Smart-Start Decoding for Neural Machine Translation. | Jian Yang, Shuming Ma, Dongdong Zhang, Juncheng Wan, Zhoujun Li, Ming Zhou |
| 2020 | AAAI | Alternating Language Modeling for Cross-Lingual Pre-Training. | Jian Yang, Shuming Ma, Dongdong Zhang, Shuangzhi Wu, Zhoujun Li, Ming Zhou |
| 2020 | ACL | A Simple and Effective Unified Encoder for Document-Level Machine Translation. | Shuming Ma, Dongdong Zhang, Ming Zhou |
| 2020 | ACL | Improving Neural Machine Translation with Soft Template Prediction. | Jian Yang, Shuming Ma, Dongdong Zhang, Zhoujun Li, Ming Zhou |
| 2020 | ECAI | Multimodal Matching Transformer for Live Commenting. | Chaoqun Duan, Lei Cui, Shuming Ma, Furu Wei, Conghui Zhu, Tiejun Zhao |
| 2019 | AAAI | Hierarchical Encoder with Auxiliary Supervision for Neural Table-to-Text Generation: Learning Better Representation for Tables. | Tianyu Liu, Fuli Luo, Qiaolin Xia, Shuming Ma, Baobao Chang, Zhifang Sui |
| 2019 | AAAI | LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts. | Shuming Ma, Lei Cui, Damai Dai, Furu Wei, Xu Sun |
| 2019 | ACL | Key Fact as Pivot: A Two-Stage Model for Low Resource Table-to-Text Generation. | Shuming Ma, Pengcheng Yang, Tianyu Liu, Peng Li, Jie Zhou, Xu Sun |
| 2019 | ACL | A Deep Reinforced Sequence-to-Set Model for Multi-Label Classification. | Pengcheng Yang, Fuli Luo, Shuming Ma, Junyang Lin, Xu Sun |
| 2018 | ACL | Global Encoding for Abstractive Summarization. | Junyang Lin, Xu Sun, Shuming Ma, Qi Su |
| 2018 | ACL | Autoencoder as Assistant Supervisor: Improving Text Representation for Chinese Social Media Text Summarization. | Shuming Ma, Xu Sun, Junyang Lin, Houfeng Wang |
| 2018 | ACL | Bag-of-Words as Target for Neural Machine Translation. | Shuming Ma, Xu Sun, Yizhong Wang, Junyang Lin |
| 2018 | ACL | Automatic Academic Paper Rating Based on Modularized Hierarchical Convolutional Neural Network. | Pengcheng Yang, Xu Sun, Wei Li, Shuming Ma |
| 2018 | COLING | Deconvolution-Based Global Decoding for Neural Machine Translation. | Junyang Lin, Xu Sun, Xuancheng Ren, Shuming Ma, Jinsong Su, Qi Su |
| 2018 | COLING | A Neural Question Answering Model Based on Semi-Structured Tables. | Hao Wang, Xiaodong Zhang, Shuming Ma, Xu Sun, Houfeng Wang, Mengxiang Wang |
| 2018 | COLING | SGM: Sequence Generation Model for Multi-label Classification. | Pengcheng Yang, Xu Sun, Wei Li, Shuming Ma, Wei Wu, Houfeng Wang |
| 2018 | COLING | Does Higher Order LSTM Have Better Accuracy for Segmenting and Labeling Sequence Data? | Yi Zhang, Xu Sun, Shuming Ma, Yang Yang, Xuancheng Ren |
| 2018 | EMNLP | Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification. | Junyang Lin, Qi Su, Pengcheng Yang, Shuming Ma, Xu Sun |
| 2018 | EMNLP | Phrase-level Self-Attention Networks for Universal Sentence Encoding. | Wei Wu, Houfeng Wang, Tianyu Liu, Shuming Ma |
| 2018 | IJCAI | A Hierarchical End-to-End Model for Jointly Improving Text Summarization and Sentiment Classification. | Shuming Ma, Xu Sun, Junyang Lin, Xuancheng Ren |
| 2018 | NAACL | Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation. | Shuming Ma, Xu Sun, Wei Li, Sujian Li, Wenjie Li, Xuancheng Ren |
| 2017 | ACL | Improving Semantic Relevance for Sequence-to-Sequence Learning of Chinese Social Media Text Summarization. | Shuming Ma, Xu Sun, Jingjing Xu, Houfeng Wang, Wenjie Li, Qi Su |
| 2017 | ICML | meProp: Sparsified Back Propagation for Accelerated Deep Learning with Reduced Overfitting. | Xu Sun, Xuancheng Ren, Shuming Ma, Houfeng Wang |