Bio
- Kai Zheng is currently a research scientist at Microsoft AI. He contribute core deep models for Microsoft XiaoIce (微软小冰), Bing Search Ranking and Microsoft Copilot.
- Creator of WizardLM, which contributed the state-of-the-art LLMs WizardLM, WizardCoder and WizardMath, I also created widely adopted methods Evol-Instruct.
- Kai Zheng has published papers in top-tier international conferences, such as ICLR, ACL, EMNLP, KDD etc.
- His research interests include large language model, reinforcement learning, multi-modal llm, dialogue systems, and information retrieval.
- He received master’s degree (advisor was Houfeng Wang (王厚峰)) in Institute of Computational Linguistics from Peking University.
Recent News
- [2024.04] Release WizardLM-2, which outperforms GPT-4 on MT-Bench, GPT4-Turbo on AlpacaEval 2.0 and Claude 3 Sonnet on Arena-Hard.
- [2023.06] WizardLM achieves the 1st-rank of the opensource models on Standford AlpacaEval Leaderboard.
- [2023.04] Release WizardLM expertized in following complex instructions. [Github] (Over 9K Stars) [WizardLM Pages] [Huggingface] [Beeboom: 12 Best LLMs in 2024] [华尔街见闻]
- 1 long paper accepted by ICLR 2024!
- 1 long paper about Adversarial Knowledge Stimulated Contrastive Prompting for Few-shot Language Learners accepted by ACL 2023!
- 1 long paper about Self-Supervised Multi-Modal Sequential Recommendation arxiv!
- 1 long paper about Knowledge Stimulated Contrastive Prompting for Low-Resource Stance Detection accepted by EMNLP 2022!
- 1 long paper about Multimodal Dialogue Response Generation accepted by ACL 2022!
Hiring
- looking for highly self-motivated students to work with me as research interns
Publications
*: Equal contribution
WizardLM: Empowering Large Language Models to Follow Complex Instructions
Can Xu*, Qingfeng Sun*, Kai Zheng*, Xiubo Geng, Pu Zhao, Jiazhan Feng, Chongyang Tao, Daxin Jiang
ICLR 2024Adversarial Knowledge Stimulated Contrastive Prompting for Few-shot Language Learners
Kai Zheng,Qingfeng Sun, Yaming Yang, Tengchao Lv, Yeyong Pi, changlin zhao, Fei Xu, Qi Zhang.
ACL 2023 findings.
Self-Supervised Multi-Modal Sequential Recommendation
Kunzhe Song, Qingfeng Sun, Can Xu, Kai Zheng, Yaming Yang
arXiv preprint arXiv:2304.13277
Knowledge Stimulated Contrastive Prompting for Low-Resource Stance Detection
Kai Zheng, Qingfeng Sun, Yaming Yang, Fei Xu
EMNLP-2022 findings.
Multimodal Dialogue Response Generation
Qingfeng Sun, Yujing Wang, Can Xu, Kai Zheng, Yaming Yang, Huang Hu, Fei Xu, Jessica Zhang, Xiubo Geng, Daxin Jiang.
ACL 2022.
Working Experiences
- ERNIE-team Baidu(百度文心), GLUE@Top1
- LTR-team Baidu, Core Search Ranking
- Reco Ranking Modeling team Kuaishou, Core Recommendation Ranking, Ship models on products Kuaishou
Academic Services
Program Committee for
- ICLR 2025
- NeurIPS 2024
- NAACL 2024
- COLM 2024
- EMNLP 2022,2023,2024
- ACL 2022, 2023
- KDD 2022, 2023