Skip to content

Pengcheng He

Publication record assembled from the DBLP archive of ranked conferences.

Papers indexed

44

Venues

10

Active years

2017–2026

Best venue rank

A*

Where they publish

Papers

44 indexed papers, newest first.

YearVenueTitleAuthors
2026ACLContextCheck: Sentence-Level Faithfulness Verification with Context-Aware Disambiguation.Yueqin Yin, Yaxi Li, Xin Liu, Xun Wang, Kaiqiang Song, Simin Ma, Shujian Liu, Sathish Reddy Indurthi, Haoyun Deng, Pengcheng He, Mingyuan Zhou, Song Wang
2025ICMLDeep Reinforcement Learning from Hierarchical Preference Design.Alexander Bukharin, Yixiao Li, Pengcheng He, Tuo Zhao
2024COLINGPROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization.Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, Nan Duan
2024EACLPersonalized Abstractive Summarization by Tri-agent Generation Pipeline.Wen Xiao, Yujia Xie, Giuseppe Carenini, Pengcheng He
2024EMNLPEvaluating the Instruction-Following Robustness of Large Language Models to Prompt Injection.Zekun Li, Baolin Peng, Pengcheng He, Xifeng Yan
2024ICLRSeeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective.Ming Zhong, Chenxin An, Weizhu Chen, Jiawei Han, Pengcheng He
2024ICLRDoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models.Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James R. Glass, Pengcheng He
2024ICLRLoftQ: LoRA-Fine-Tuning-aware Quantization for Large Language Models.Yixiao Li, Yifan Yu, Chen Liang, Nikos Karampatziakis, Pengcheng He, Weizhu Chen, Tuo Zhao
2024ICLRLearning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling.Huangjie Zheng, Zhendong Wang, Jianbo Yuan, Guanghan Ning, Pengcheng He, Quanzeng You, Hongxia Yang, Mingyuan Zhou
2024ICMLSwitchable Decision: Dynamic Neural Generation Networks.Shujian Zhang, Korawat Tanwisuth, Chengyue Gong, Pengcheng He, Mingyuan Zhou
2023ACLZ-Code++: A Pre-trained Language Model Optimized for Abstractive Summarization.Pengcheng He, Baolin Peng, Song Wang, Yang Liu, Ruochen Xu, Hany Hassan, Yu Shi, Chenguang Zhu, Wayne Xiong, Michael Zeng, Jianfeng Gao, Xuedong Huang
2023ACLDIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization.Yu Li, Baolin Peng, Pengcheng He, Michel Galley, Zhou Yu, Jianfeng Gao
2023EMNLPQuery Rewriting in Retrieval-Augmented Large Language Models.Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, Nan Duan
2023EMNLPLMGQS: A Large-scale Dataset for Query-focused Summarization.Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Pengcheng He, Chenguang Zhu, Michael Zeng
2023ICLRDeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing.Pengcheng He, Jianfeng Gao, Weizhu Chen
2023ICLRDiffusion-GAN: Training GANs with Diffusion.Zhendong Wang, Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
2023ICLRAdaptive Budget Allocation for Parameter-Efficient Fine-Tuning.Qingru Zhang, Minshuo Chen, Alexander Bukharin, Pengcheng He, Yu Cheng, Weizhu Chen, Tuo Zhao
2023ICLRTruncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders.Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
2023ICMLLess is More: Task-aware Layer-wise Distillation for Language Model Compression.Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao
2023ICMLLoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation.Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao
2023ICMLHyperTuning: Toward Adapting Large Language Models without Back-propagation.Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen
2023ICMLPOUF: Prompt-Oriented Unsupervised Fine-tuning for Large Pre-trained Models.Korawat Tanwisuth, Shujian Zhang, Huangjie Zheng, Pengcheng He, Mingyuan Zhou
2022ACLCAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing.Chen Liang, Pengcheng He, Yelong Shen, Weizhu Chen, Tuo Zhao
2022ICLRNo Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models.Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2022ICMLPLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance.Qingru Zhang, Simiao Zuo, Chen Liang, Alexander Bukharin, Pengcheng He, Weizhu Chen, Tuo Zhao
2022IJCAIHuman Parity on CommonsenseQA: Augmenting Self-Attention with External Attention.Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
2022NAACLOmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering.Zhengbao Jiang, Yi Mao, Pengcheng He, Graham Neubig, Weizhu Chen
2022NAACLALLSH: Active Learning Guided by Local Sensitivity and Hardness.Shujian Zhang, Chengyue Gong, Xingchao Liu, Pengcheng He, Weizhu Chen, Mingyuan Zhou
2022NAACLMoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation.Simiao Zuo, Qingru Zhang, Chen Liang, Pengcheng He, Tuo Zhao, Weizhu Chen
2021ACLUnitedQA: A Hybrid Approach for Open Domain Question Answering.Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
2021ACLSuper Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization.Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen
2021ACLGeneration-Augmented Retrieval for Open-Domain Question Answering.Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen
2021ACLReader-Guided Passage Reranking for Open-Domain Question Answering.Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen
2021EMNLPToken-wise Curriculum Learning for Neural Machine Translation.Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Tuo Zhao
2021EMNLPARCH: Efficient Adversarial Regularized Training with Caching.Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021EMNLPAdversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach.Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021ICLRDeberta: decoding-Enhanced Bert with Disentangled Attention.Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen
2020ACLSMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization.Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
2020ACLThe Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding.Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
2020EMNLPExploiting Structured Knowledge in Text via Graph-Guided Representation Learning.Tao Shen, Yi Mao, Pengcheng He, Guodong Long, Adam Trischler, Weizhu Chen
2020ICLROn the Variance of the Adaptive Learning Rate and Beyond.Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
2020WCNCRobust TOA-Based Source Self-Positioning With Clock Imperfection.Pengcheng He, Xiaohu Jiang, Qingjiang Shi
2019ACLMulti-Task Deep Neural Networks for Natural Language Understanding.Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
2017WWWScalable Deep Document / Sequence Reasoning with Cognitive Toolkit.Sayan Pathak, Pengcheng He, William Darling