Cheng DENG

About Me

Currently, I am a Research Fellow at the Bayes Centre, the University of Edinburgh, working in collaboration with Prof. Luo Mai, Prof. Jeff Pan, and Prof. Jun Wang. Prior to joining the University of Edinburgh, I was a Research Assistant at the Hong Kong University of Science and Technology (Guangzhou), where I worked with Prof. Lei Chen and Prof. Lionel M. Ni. I obtained my Ph.D. in Computer Science from the Acemap IIOT Lab at Shanghai Jiao Tong University, where I had the privilege of being supervised by Prof. Weinan Zhang, Prof. Luoyi Fu, and Prof. Xinbing Wang. During my early research career, I interned with the Data Team at TikTok and as an Applied Scientist at Amazon Shanghai AI Lab. In 2021, I was also selected for the Wenjun Wu Honored Ph.D. Class.

Research Interests

Natural Language Processing : Long-context LLM, Hardware-co-Designed LLM
AI for Science and Social Goods: GeoAI, Scientific Data Mining

Highlight

We release the The PLM (Peripheral Language Model) series, a novel model architecture to peripheral computing by delivering powerful language capabilities within the constraints of resource-limited devices. In the future, the PLM Team will keep doing research on PLM with modeling and system co-design.

Paper: https://arxiv.org/abs/2503.12167
Project: https://www.project-plm.com
Github: https://github.com/plm-team/PLM
Hugging Face: https://huggingface.co/PLM-Team

PLM-v and PLM-vla is coming soon!

News

[2025-06] Invited talk about “PLM: Peripheral Language Model” on RLChina Roundtable Discussion!
[2025-01] Invited talk about “GeoAI with LLM” in University of Leeds, Leeds, UK!
[2024-12] Invited talk about “Boosting Scientific discovery in the Earth sciences via Large Languag Model Agent” in Yunlong Lake-Loch Lomond Symposium 24 at University of Strathclyde, Glasgow, UK!
[2024-10] Organized talk about “Advanced Techniques for LLM” and tutorial about “Full Stack Practice of LLM Training” in RLChina 24, Guangzhou, China! The material of the tutorial is on GitHub.

Publications [Google Citation]

Preprint PLM: Efficient Peripheral Language Models Hardware-Co-Designed for Ubiquitous Computing

Cheng Deng, Luoyang Sun, Jiwen Jiang, Yongcheng Zeng, Xinjian Wu, Wenxin Zhao, Qingfa Xiao, Jiachuan Wang, Haoyang Li, Lei Chen, Lionel M. Ni, Haifeng Zhang, Jun Wang

PDF Code
ICASSP2025 AceParse: A Comprehensive Dataset with Diverse Structured Texts for Academic Literature Parsing

Huawei Ji, Cheng Deng, Bo Xue, Zhouyang Jin, Jiaxin Ding, Xiaoying Gan, Luoyi Fu, Xinbing Wang, Chenghu Zhou

IEEE International Conference on Acoustics, Speech, and Signal Processing

PDF Code
ECAI2024 A Language Model as a Design Assistant for UI Design Recommendation and Evaluation

Lin Sheng, Cheng Deng, Junjie Zhang, Fangyuan Chang, Qinghua Sun, Hongyu Liu and Zhenyu Gu

European Conference on Artifical Intelligence
ICML2024 DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning

Siyuan Guo, Cheng Deng, Ying Wen, Hechang Chen, Yi Chang, Jun Wang

International Conference on Machine Learning

PDF Code
Preprint GeoGalactica: A Scientific Large Language Model in Geoscience

Zhouhan Lin, Cheng Deng, Le Zhou, Tianhang Zhang, Yi Xu, Luoyi Fu, Weinan Zhang, Junxian He, Chao Ma, Yunqiang Zhu, Xinbing Wang, Chenghu Zhou, et al.

PDF Code
WSDM2024 K2: A Foundation Language Model for Geoscience Knowledge Understanding and Utilization

Cheng Deng, Tianhang Zhang, Zhongmou He, Yi Xu, Qiyuan Chen, Yuanyuan Shi, Luoyi Fu, Weinan Zhang, Xinbing Wang, Chenghu Zhou, Zhouhan Lin, Junxian He

WSDM, 2024

PDF Code
TNSE RWE: A Random Walk based Graph Entropy for the Structural Complexity of Directed Networks

Chong Zhang, Cheng Deng, Luoyi Fu, Xinbing Wang, Guihai Chen, Lei Zhou, Chenghu Zhou

IEEE Transactions on Network Science and Engineering (TNSE)
EMNLP2023 Enhancing Uncertainty-Based Hallucination Detection with Stronger Focus

Tianhang Zhang, Lin Qiu, Qipeng Guo, Cheng Deng, Yue Zhang, Zheng Zhang, Chenghu Zhou, Xinbing Wang, Luoyi Fu

EMNLP, 2024
Preprint FMGNN: Fused Manifold Graph Embedding via Geometry Coreset

Cheng Deng, Fan Xu, Jiaxing Ding, Weinan Zhang, Luoyi Fu, Xinbing Wang, Chenghu Zhou, et al.

PDF Under Review
EJIM 'Paperdemic' during the COVID-19 pandemic

Yang Yang, Na Zhao, Ting Ma, Ze Yuan, Cheng Deng, et al.

European Journal of Internal Medicine, 2022

PDF
CIKM2021 GAKG: A Multimodal GeoScience Academic Knowledge Graph

Cheng Deng, Yuting Jia, Weinan Zhang, Luoyi Fu, Xinbing Wang, Chenghu Zhou, et al.

CIKM, 2021

PDF Code
IJCKG2023 PK-Chat: Pointer Network Guided Knowledge Driven Generative Dialogue Model

Cheng Deng, Bo Tong, Luoyi Fu, Jiaxin Ding, Dexing Cao, Xinbing Wang, Chenghu Zhou

International Joint Conference on Knowledge Graphs

PDF Code
IJCKG2023 Covidia: COVID-19 Interdisciplinary Academic Knowledge Graph Construction and Application

Cheng Deng, Jiaxing Ding, Weinan Zhang, Luoyi Fu, Xinbing Wang, Chenghu Zhou

International Joint Conference on Knowledge Graphs
FCS EvolveKG: A General Framework to Learn Evolving Knowledge Graphs

Jiaqi Liu, Zhiwen Yu, Bin Guo, Cheng Deng, Luoyi Fu, Xinbing Wang, Chenghu Zhou

Frontiers of Computer Science, 2022

Code
TMC Evolving Bipartite Model Reveals the Bounded Weights in Mobile Social Networks: A Case Study in Recommendation Network

Jiaqi Liu, Cheng Deng, Luoyi Fu, Xinbing Wang

IEEE Transactions on Mobile Computing, 2020

PDF Code

Services

Teaching Assistant

[Mobile Networks] [2019,2020,2021,2022]
[IEEI (B)] [2020] [2021,2022,2023]
[Program Design (C++)] [2020]
[Data Science CS245-2] Kaggle

Conference Reviewers

Reviewer for Conference AISTATS [2024, 2025]
Reviewer for Conference Coling [2025]
Reviewer for Conference NeurIPS [2025]
Reviewer for Conference ACL ARR [2024, 2025]
Reviewer for Conference MM [2025]

Journal Reviewers

Reviewer for Journal TKDE [2019-]
Reviewer for Journal TMC [2020]
Reviewer for Journal FCS [2023-]
Reviewer for Journal CUCS [2024]
Reviewer for Journal IJGIS [2024]
Reviewer for Journal HSSCOMMS [2024]
Reviewer for Journal SWJ [2024]
Reviewer for Journal TJDE [2024]

Talks

Presented "PLM: Peripheral Language Model" at the RLChina Roundtable Discussion. May 2025
Delivered a talk on "GeoAI with LLM" at the University of Leeds, Leeds, UK. Jan 2025
Gave a presentation on "Boosting Scientific Discovery in the Earth Sciences via Large Language Model Agents" at the Yunlong Lake–Loch Lomond Symposium 24, University of Strathclyde, Glasgow, UK. Dec 2024
Organized and presented a talk on "Advanced Techniques for LLM" and delivered a tutorial on "Full Stack Practice of LLM Training" at RLChina 24, Guangzhou, China. Tutorial materials are available on GitHub. Oct 2024
Presented "Knowledge Understanding and Utilization via Data-centric Large Language Models" at the AI-Based Future IoT Technologies and Services 2024 Workshop, Jeju, Korea. Apr 2024
Delivered a TED Talk titled "Thinking Outside the Code" at the TEDxNYUShanghai Salon (Theme: Going Meta). Feb 2024
Invited by Prof. Gengchen Mai (UGA) to present "Large Language Models in Geoscience" at the GeoAI seminar. Aug 2023
Presented "Building a Sustainable Text Corpus for Geoscience" at the DDE Conference, China University of Geosciences (Beijing). Sept 2023
Gave a talk on "K2: Geoscience LLM" at the LLM Conference hosted by AI Time. Jan 2024
Presented "The History of Geoscience Language Models" at the DDE Conference, Zhejiang Lab. Jan 2024