About Me
I obtained my Ph.D. in Computer Science in Acemap, IIOT Lab, at Shanghai Jiao Tong University, where I have the honor of being supervised by Prof. Weinan Zhang, Prof. Luoyi Fu and Prof. Xinbing Wang. During my early research career, I’ve been interning at TikTok in the Data team, and I also interned as applied scientist at Amazon Shanghai AI Lab. Moreover, I was selected into Wenjun Wu Honored Ph.D. Class in 2021.
During my doctoral period, one of the key feedbacks I receive from industry projects and interdisciplinary collaborators is that the LLM should be highly reliable and efficient deployment in actual application. So I adjust my focus to LLM system in the coming career. Recently, I am devoted to the research of on-device large language model, doing some projects about the training, deployment, and the application of LLM for edge-side or IoT.
Research Interests
- Natural Language Processing : Long-context LLM, On-device LLM
- Machine Learning: ML-System co-Design, Distributed ML
- AI for Science and Social Goods: GeoAI, AI for Design
Highlight
We release the The PLM (Peripheral Language Model) series, a novel model architecture to peripheral computing by delivering powerful language capabilities within the constraints of resource-limited devices. In the future, the PLM Team will keep doing research on PLM with modeling and system co-design.
News
- [2025-01] Invited talk about “GeoAI with LLM” in University of Leeds, Leeds, UK!
- [2024-12] Our Paper “AceParse: A Comprehensive Dataset with Diverse Structured Texts for Academic Literature Parsing” has been accpeted by ICASSP 2025!
- [2024-12] Invited talk about “Boosting Scientific discovery in the Earth sciences via Large Languag Model Agent” in Yunlong Lake-Loch Lomond Symposium 24 at University of Strathclyde, Glasgow, UK!
- [2024-10] Organized talk about “Advanced Techniques for LLM” and tutorial about “Full Stack Practice of LLM Training” in RLChina 24, Guangzhou, China! The material of the tutorial is on GitHub.
-
Cheng Deng, Luoyang Sun, Jiwen Jiang, Yongcheng Zeng, Xinjian Wu, Wenxin Zhao, Qingfa Xiao, Jiachuan Wang, Haoyang Li, Lei Chen, Lionel M. Ni, Haifeng Zhang, Jun Wang
-
Huawei Ji, Cheng Deng, Bo Xue, Zhouyang Jin, Jiaxin Ding, Xiaoying Gan, Luoyi Fu, Xinbing Wang, Chenghu Zhou
IEEE International Conference on Acoustics, Speech, and Signal Processing
-
Lin Sheng, Cheng Deng, Junjie Zhang, Fangyuan Chang, Qinghua Sun, Hongyu Liu and Zhenyu Gu
European Conference on Artifical Intelligence
-
Siyuan Guo, Cheng Deng, Ying Wen, Hechang Chen, Yi Chang, Jun Wang
International Conference on Machine Learning
-
Zhouhan Lin, Cheng Deng, Le Zhou, Tianhang Zhang, Yi Xu, Luoyi Fu, Weinan Zhang, Junxian He, Chao Ma, Yunqiang Zhu, Xinbing Wang, Chenghu Zhou, et al.
-
Cheng Deng, Tianhang Zhang, Zhongmou He, Yi Xu, Qiyuan Chen, Yuanyuan Shi, Luoyi Fu, Weinan Zhang, Xinbing Wang, Chenghu Zhou, Zhouhan Lin, Junxian He
WSDM, 2024
-
Chong Zhang, Cheng Deng, Luoyi Fu, Xinbing Wang, Guihai Chen, Lei Zhou, Chenghu Zhou
IEEE Transactions on Network Science and Engineering (TNSE)
-
Tianhang Zhang, Lin Qiu, Qipeng Guo, Cheng Deng, Yue Zhang, Zheng Zhang, Chenghu Zhou, Xinbing Wang, Luoyi Fu
EMNLP, 2024
-
Cheng Deng, Fan Xu, Jiaxing Ding, Weinan Zhang, Luoyi Fu, Xinbing Wang, Chenghu Zhou, et al.
-
Yang Yang, Na Zhao, Ting Ma, Ze Yuan, Cheng Deng, et al.
European Journal of Internal Medicine, 2022
-
Cheng Deng, Yuting Jia, Weinan Zhang, Luoyi Fu, Xinbing Wang, Chenghu Zhou, et al.
CIKM, 2021
-
Cheng Deng, Bo Tong, Luoyi Fu, Jiaxin Ding, Dexing Cao, Xinbing Wang, Chenghu Zhou
International Joint Conference on Knowledge Graphs
-
Cheng Deng, Jiaxing Ding, Weinan Zhang, Luoyi Fu, Xinbing Wang, Chenghu Zhou
International Joint Conference on Knowledge Graphs
-
Jiaqi Liu, Zhiwen Yu, Bin Guo, Cheng Deng, Luoyi Fu, Xinbing Wang, Chenghu Zhou
Frontiers of Computer Science, 2022
-
Jiaqi Liu, Cheng Deng, Luoyi Fu, Xinbing Wang
IEEE Transactions on Mobile Computing, 2020
Services
Teaching Assistant
Conference Reviewers
- Reviewer for Conference AISTATS [2024, 2025]
- Reviewer for Conference Coling [2025]
Journal Reviewers
- Reviewer for Journal TKDE [2019-]
- Reviewer for Journal TMC [2020]
- Reviewer for Journal FCS [2023-]
- Reviewer for Journal CUCS [2024]
- Reviewer for Journal IJGIS [2024]
- Reviewer for Journal HSSCOMMS [2024]
- Reviewer for Journal SWJ [2024]
- Reviewer for Journal TJDE [2024]
Talks
- Attending AI-Based Future IoT Technologies and Services 2024 Workshop in Jeju, Korea, I gave a talk about "Knowledge Understanding and Utilization via Data-centric Large Language Model", Apr. 2024.
- Attending TEDxNYUShanghai Salon with the theme of "Going Meta", I gave a TED talk "Thinking Outside the Code"Feb. 2024.
- Invited by Prof. Gengchen Mai from UGA, I gave a talk with on topic of "large language model in geoscience" in the seminar of GeoAI, Aug. 2023.
- Attending DDE Conference hosted by China University of Geosciences (Beijing), I gave a talk about "Building a sustainable text corpus for geoscience", Sept. 2023.
- Attending LLM Conference hosted by AI Time, I gave a talk about "K2: Geoscience LLM", Jan. 2024.
- Attending DDE Conference hosted by Zhejiang Lab, I gave a talk about "The history of Geoscience Language Model", Jan. 2024.
Powered by Jekyll and Minimal Light theme.