Cheng Deng | Shanghai Jiao Tong University

About Me

Currently, I’m pursuing my doctoral degree in Computer Science in Acemap, IIOT Lab, at Shanghai Jiao Tong University, where I have the honor of being supervised by Prof. Weinan Zhang, Prof. Luoyi Fu and Prof. Xinbing Wang. I was also selected into Wenjun Wu Honored Ph.D. Class in 2021.

Recently, I am devoted to the research of specialized domain large language models (collaborating with Prof. Junxian He and Prof. Zhouhan Lin) and utilizing AI techniques especially LLM as AI Agents to solve data science related real-life issues (collaborating with Prof. Ying Wen).

Research Interests

Natural Language Processing : Long-context LLM, Hardware-awared Language Modeling, AI Agent
Machine Learning: Distributed ML, ML System
AI for Science and Social Goods: GeoAI, AI for Design

News

[2024-04] Our Paper “DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning” has been accpeted by ICML 2024!
[2024-02] 3 Papers about AI for Geoscience are accpeted by EGU 2024!
[2024-01] GeoGalactica, A Scientific Large Language Model in Geoscience is open-sourced on geobrain-ai/geogalactica! The technical report is on arXiv:2401.00434!
[2023-10] Our paper “Learning A Foundation Language Model for Geoscience Knowledge Understanding and Utilization” (The K2) has been accepted by WSDM-2024!
[2023-11] Our paper “RWE: A Random Walk Based Graph Entropy for the Structural Complexity of Directed Networks” has been accepted by TNSE!
[2023-10] Our paper “Enhancing Uncertainty-Based Hallucination Detectionwith Stronger Focus” has been accepted by EMNLP-2023!

Publications [Google Citation]

ICML DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning

Siyuan Guo, Cheng Deng, Ying Wen, Hechang Chen, Yi Chang, Jun Wang

International Conference on Machine Learning

PDF Code
Preprint GeoGalactica: A Scientific Large Language Model in Geoscience

Zhouhan Lin, Cheng Deng, Le Zhou, Tianhang Zhang, Yi Xu, Luoyi Fu, Weinan Zhang, Junxian He, Chao Ma, Yunqiang Zhu, Xinbing Wang, Chenghu Zhou, et al.

PDF Code
WSDM2024 Learning A Foundation Language Model for Geoscience Knowledge Understanding and Utilization

Cheng Deng, Tianhang Zhang, Zhongmou He, Yi Xu, Qiyuan Chen, Yuanyuan Shi, Luoyi Fu, Weinan Zhang, Xinbing Wang, Chenghu Zhou, Zhouhan Lin, Junxian He

WSDM, 2024

PDF Code
TNSE RWE: A Random Walk based Graph Entropy for the Structural Complexity of Directed Networks

Chong Zhang, Cheng Deng, Luoyi Fu, Xinbing Wang, Guihai Chen, Lei Zhou, Chenghu Zhou

IEEE Transactions on Network Science and Engineering (TNSE)
EMNLP2023 Enhancing Uncertainty-Based Hallucination Detection with Stronger Focus

Tianhang Zhang, Lin Qiu, Qipeng Guo, Cheng Deng, Yue Zhang, Zheng Zhang, Chenghu Zhou, Xinbing Wang, Luoyi Fu

EMNLP, 2024
Preprint FMGNN: Fused Manifold Graph Embedding via Geometry Coreset

Cheng Deng, Fan Xu, Jiaxing Ding, Weinan Zhang, Luoyi Fu, Xinbing Wang, Chenghu Zhou, et al.

PDF Under Review
EJIM 'Paperdemic' during the COVID-19 pandemic

Yang Yang, Na Zhao, Ting Ma, Ze Yuan, Cheng Deng, et al.

European Journal of Internal Medicine, 2022

PDF
CIKM2021 GAKG: A Multimodal GeoScience Academic Knowledge Graph

Cheng Deng, Yuting Jia, Weinan Zhang, Luoyi Fu, Xinbing Wang, Chenghu Zhou, et al.

CIKM, 2021

PDF Code
IJCKG2023 PK-Chat: Pointer Network Guided Knowledge Driven Generative Dialogue Model

Cheng Deng, Bo Tong, Luoyi Fu, Jiaxin Ding, Dexing Cao, Xinbing Wang, Chenghu Zhou

PDF Code
IJCKG2023 Covidia: COVID-19 Interdisciplinary Academic Knowledge Graph Construction and Application

Cheng Deng, Jiaxing Ding, Weinan Zhang, Luoyi Fu, Xinbing Wang, Chenghu Zhou
FCS EvolveKG: A General Framework to Learn Evolving Knowledge Graphs

Jiaqi Liu, Zhiwen Yu, Bin Guo, Cheng Deng, Luoyi Fu, Xinbing Wang, Chenghu Zhou

Frontiers of Computer Science, 2022

Code
TMC Evolving Bipartite Model Reveals the Bounded Weights in Mobile Social Networks: A Case Study in Recommendation Network

Jiaqi Liu, Cheng Deng, Luoyi Fu, Xinbing Wang

IEEE Transactions on Mobile Computing, 2020

PDF Code

Services

Teaching Assistant

[Mobile Networks] [2019,2020,2021,2022]
[IEEI (B)] [2020] [2021,2022,2023]
[Program Design (C++)] [2020]
[Data Science CS245-2] Kaggle

Conference Reviewers

Reviewer for Conference AISTATS [2024]

Journal Reviewers

Reviewer for Journal TKDE [2019-]
Reviewer for Journal TMC [2020]
Reviewer for Journal FCS [2023]
Reviewer for Journal CUCS [2024]
Reviewer for Journal IJGIS [2024]

Talks

Invited by Prof. Gengchen Mai from UGA, I gave a talk with on topic of "large language model in geoscience" in the seminar of GeoAI, Aug. 2023.
Attending DDE Conference hosted by China University of Geosciences (Beijing), I gave a talk on "Building a sustainable text corpus for geoscience", Sept. 2023.
Attending LLM Conference hosted by AI Time, I gave a talk on "K2: Geoscience LLM", Jan. 2024.
Attending DDE Conference hosted by Zhejiang Lab, I gave a talk on "The history of Geoscience Language Model", Jan. 2024.