Welcome to Pengyu Cheng’s homepage!

I am a senior researcher at Tencent AI Lab, working on LLM training, AI agents, and dialogue systems. I have been experienced in research and projects about controllable generation, interpretability, and fairness of NLP. Besides, I have broad interests in probabilistic and information-theoretic machine learning methods.

I received my Ph.D. degree from the Department of Electric and Computer Engineering at Duke University in 2021. My Ph.D. advisor is Dr. Lawrence Carin. I graduated with my B.S. degree from the Department of Mathematical Sciences at Tsinghua University in 2017.

Selected Publications:

     
PreprintAdversarial Preference OptimizationP. Cheng*, Y. Yang*, J. Li*, Y. Dai, N. Du2023
PreprintEveryone Deserves A Reward: Learning Customized Human PreferencesP. Cheng, J. Xie, K. Bai, Y. Dai, N. Du2023
PreprintReplacing Language Model for Style TransferP. Cheng, R. Li2022
ICLRFairFil: Contrastive Neural Debiasing Method for Pretrained Text EncodersP. Cheng*, W. Hao*, S. Yuan, S. Si, L. Carin2021
ICLRImproving Zero-Shot Voice Style Transfer via Disentangled Representation LearningS. Yuan*, P. Cheng*, R. Zhang, W. Hao, Z. Gan, L. Carin2021
ICMLCLUB: A Contrastive Log-ratio Upper Bound of Mutual InformationP. Cheng, W. Hao, S. Dai, J. Liu, Z. Gan, L. Carin2020

Timeline:

  • [2023/01/21] Two co-first-author papers got accepted at AISTATS 2023.

  • [2022/08/02] Began serving as a PC for ICLR 2023 and AAAI 2023.

  • [2022/03/31] Began serving as a PC for NeurIPS 2022.

  • [2022/02/28] One paper (SoTead) got accepted by findings of ACL 2022.

  • [2021/10/28] Began serving as a reviewer for ACL Rolling Review (ARR).

  • [2021/04/20] Began serving as a PC for EMNLP 2021.

  • [2021/03/30] Finished my Ph.D. final defense! What an unforgettable journey!

  • [2021/02/06] Began serving as a PC for ACL 2021.

  • [2021/01/12] Two co-first-author papers (FairFil and IDE-VC) got accepted at ICLR 2021.

  • [2020/12/17] Began serving as a senior PC for IJCAI 2021.

  • [2020/12/14] Passed the preliminary exam and became a Ph.D. candidate.

  • [2020/08/30] Began serving as a reviewer for ICLR 2021.

  • [2020/08/14] Began serving as a reviewer for AAAI 2021.

  • [2020/06/08] Started internship at Microsoft, supervised by Dr. Jingjing Liu.

  • [2020/06/01] One paper got accepted at ICML 2020.

  • [2020/04/03] One paper got accepted at ACL 2020.

  • [2020/03/24] Began serving as a reviewer for NeurIPS 2020.

  • [2020/02/09] Provided an oral presentation at AAAI 2020.

  • [2019/11/14] Began serving as a reviewer for ICML 2020.

  • [2019/11/09] One paper got accepted for an oral presentation at AAAI 2020.

  • [2019/08/07] Began serving as a reviewer for AAAI 2020.

  • [2019/05/28] Started internship at NEC Labs America, advised by Dr. Martin Renqiang Min.

  • [2019/05/13] Two papers got accepted at ACL 2019. My co-first-author paper was selected for an oral presentation.

  • [2019/04/24] One paper got accepted at ICML 2019.

  • [2018/11/16] One paper got accepted at NeurIPS 2018 Bayesian Deep Learning workshop as spotlight presentation.