I am a Master’s student from Tongji University. I am working in the TOPS Lab, and supervised by Professor Jian Sun and Peng Hang. I interned at UC Berkeley as a visiting student researcher, where I collaborated with Prof. Masayoshi Tomizuka, Prof. Mingyu Ding, and Dr. Wei Zhan.

My research interests include embodied AI, robot learning, autonomous vehicles, reinforcement learning , and foundation models. And my research goal is to develop intelligent robotic systems and general-purpose robotic foundation models, advancing embodied agents capable of sophisticated reasoning, adaptive decision-making, and effective interaction within dynamic, real-world environments.

🔥 News

2025.05: One paper entitled Towards Human-Centric Autonomous Driving: A Fast-Slow Architecture Integrating Large Language Model Guidance with Reinforcement Learning is pre-printed.
2025.03: 🎉🎉 One paper is accepted by IEEE Transactions on Vehicular Technology(SCI, Q1).
2025.03: One paper entitled Interact, Instruct to Improve: A LLM-Driven Parallel Actor-Reasoner Framework for Enhancing Autonomous Vehicle Interactions is pre-printed.
2025.02: 🎉🎉 One paper (first author) is accepted by IEEE Robotics and Automation Letters (RA-L).
2025.02: One paper entitled TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learning is pre-printed.
2024.11: 🎉🎉 One paper (first author) is accepted by IEEE Transactions on Intelligent Transportation Systems (SCI, Q1).
2024.11: 🎉🎉 One paper (first author) is accepted by IEEE Transactions on Artificial Intelligence.
2024.11: One paper entitled Language-Driven Policy Distillation for Cooperative Driving in Multi-Agent Reinforcement Learning is pre-printed on Arxiv.
2024.10: 🎉🎉 One paper (first author) is accepted by IEEE Transactions on Intelligent Vehicles(SCI, Q1).
2024.09: One paper entitled Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-making Framework is pre-printed.
2024.08: 🎉🎉 One paper (Co-first author) is accepted by ECCV 2024 MAAS Workshop(Oral)
2024.08: 🎉🎉 I won the IEEE ITSC 2024 Travel Award.
2024.07: 🎉🎉 One paper (first author) is accepted by ITSC 2024.
2024.06: 🎉🎉 One paper (first author) is accepted by Transportmetrica B: Transport Dynamics.
2024.04: 🎉🎉 One paper (first author) is accepted by IEEE Transactions on Vehicular Technology(SCI, Q1).
2023.11: 🎉🎉 One paper (first author) is accepted by IEEE Transactions on Intelligent Vehicles(SCI, Q1).
2023.10: 🎉 One paper (first author) is accepted by Transportation Research Board 103th Annual MeetingTransportation Research Board.
2023.07: 🎉🎉 As the first author or the corresponding author, I got three papers accepted by the 26th IEEE International Conference on Intelligent Transportation Systems (ITSC 2023)!
2022.09: 🎉🎉 I was bestowed with the Nominee Award for Shanghai University Student Annual Character, a recognition of paramount importance in evaluating the comprehensive aptitudes and societal influence of college students within the Shanghai municipality. Only 20 people in Shanghai receive the award each year (including nominees)!
2022.06: 🎉🎉 I received my Bachelor degree from Tongji University with the first overall ranking in my major (1/163), and I got the honor of Shanghai Outstanding Graduate(Top 1%)!
2021.05: 🎉🎉 I received the Tongji University Pursuit of Excellence Award, the highest honor for undergraduates at Tongji University! Only three undergraduates are able to receive this honor each year!
2020.11: 🎉🎉 I won the only Grand Prize in the China Reverse Logistics Design Competition
2020.10: 🎉🎉 I won the Best Paper Award in CUMCM! CUMCM is the largest basic academic competition for undergraduate students in China, and 3 papers were awarded from 42,000+ candidates!
2020.10: 🎉🎉 I won the first prize of China Transportation Science and Technology Competition, which is the most important undergraduate academic competition in China’s transportation field!
🎉🎉🎉: My story and work during my undergraduate studies were reported by several influential Chinese media outlets. You can find more content here: 1, 2, 3

📝 Publications

DDM-Lag : A Diffusion-based Decision-making Model for Autonomous Vehicles with Lagrangian Safety Enhancement

Jiaqi Liu, Peng Hang, Xiaocong Zhao, Jianqiang Wang, Jian Sun, IEEE Transactions on Artificial Intelligence(TAI), DOI: 10.1109/TAI.2024.3497918.

Language-Driven Policy Distillation for Cooperative Driving in Multi-Agent Reinforcement Learning

Jiaqi Liu, Chengkai Xu, Peng Hang, Jian Sun, Mingyu Ding, Wei Zhan, Masayoshi Tomizuka, IEEE Robotics and Automation Letters (RA-L), DOI: 10.1109/LRA.2025.3551098.

Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors

Jiaqi Liu, Peng Hang, Xiaoxiang Na, Chao Huang, Jian Sun, IEEE Transactions on Intelligent Transportation Systems (TITS), DOI: 10.1109/TITS.2024.3503092, 2024.

Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness

Jiaqi Liu, Donghao Zhou, Peng Hang, Ying Ni, Jian Sun, IEEE Transactions on Intelligent Vehicles (TIV), DOI: 10.1109/TIV.2023.3332080, 2023.

Human-Like Implicit Intention Expression for Autonomous Driving Motion Planning: A Method Based on Learning Human Intention Priors

Jiaqi Liu, Xiao Qi, Ying Ni, Jian Sun, Peng Hang, IEEE Transactions on Intelligent Vehicles (TIV), DOI: 10.1109/TIV.2024.3487527, 2024.

Enhancing Social Decision-Making of Autonomous Vehicles: A Mixed-Strategy Game Approach With Interaction Orientation Identification

Jiaqi Liu, Xiao Qi, Peng Hang, Jian Sun, IEEE Transactions on Vehicular Technology (TVT), DOI:10.1109/TVT.2024.3385750.

MAPPO-PIS: A Multi-Agent Proximal Policy Optimization Method with Prior Intent Sharing for CAVs’ Cooperative Decision-Making

Yicheng Guo$^\star$, Jiaqi Liu$^\star$, Rongjie Yu, Peng Hang, Jian Sun, accepted by ECCV 2024 MAAS Workshop(Oral).

MTD-GPT: A Multi-Task Decision-Making GPT Model for Autonomous Driving at Unsignalized Intersections

Jiaqi Liu, Peng Hang, Xiao Qi, Jianqiang Wang, Jian Sun, IEEE 26th International Conference on Intelligent Transportation Systems (ITSC), Bilbao, Spain, 2023.

Delay-Aware Multi-Agent Reinforcement Learning for Cooperative Adaptive Cruise Control with Model-based Stability Enhancement

Jiaqi Liu, Ziran Wang, Peng Hang, and Jian Sun, accepted by ITSC 2024.

A Decision-Making GPT Model Augmented with Entropy Regularization for Autonomous Vehicles

Jiaqi Liu, Shiyu Fang, Xuekai Liu, Lulu Guo, Peng Hang, Jian Sun, 8th CAA International Conference on Vehicular Control and Intelligence (CVCI 2024)

Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-making Framework

Shiyu Fang, Jiaqi Liu, Mingyu Ding, Chen Lv, Peng Hang, Jian Sun, IEEE Transactions on Vehicular Technology, DOI: 10.1109/TVT.2025.3552922.

Evaluation of Drivers’ Interaction Ability at Social Scenarios: A Process-Based Framework

Jiaqi Liu, Peng Hang, Xiangwang Hu, Jian Sun, Transportmetrica B: Transport Dynamics, DOI: 10.1080/21680566.2024.2380913.

TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learning

Chengkai Xu, Jiaqi Liu, Peng Hang, Jian Sun, preprint.

Interact, Instruct to Improve: A LLM-Driven Parallel Actor-Reasoner Framework for Enhancing Autonomous Vehicle Interactions, Shiyu Fang, Jiaqi Liu, Chengkai Xu, Chen Lv, Peng Hang, Jian Sun, preprint.
Towards Safe and Robust Autonomous Vehicle Platooning: A Self-Organizing Cooperative Control Framework, Chengkai Xu, Zihao Deng, Jiaqi Liu$^\star$, Chao Huang, Peng Hang$^\star$, preprint.
Optimal Placement of Charging Stations in Road Networks: A Reinforcement Learning Approach with Attention Mechanism, Jiaqi Liu, Jian Sun, and Xiao Qi, Applied Sciences 13.14 (2023): 8473.
Design of the Reverse Logistics System for Medical Waste Recycling Part I: System Architecture, Classification & Monitoring Scheme, and Site Selection Algorithm, Chaozhong Xue, Yongqi Dong, Jiaqi Liu$^\star$, Yijun Liao, Lingbo, IEEE 26th International Conference on Intelligent Transportation Systems (ITSC), Bilbao, Spain, 2023.
Design of the Reverse Logistics System for Medical Waste Recycling Part II: Route Optimization with Case Study under COVID-19 Pandemic, Chaozhong Xue, Yongqi Dong, Jiaqi Liu$^\star$, Yijun Liao, Lingbo, IEEE 26th International Conference on Intelligent Transportation Systems (ITSC), Bilbao, Spain, 2023.
Surrogate Evaluation Model for Assessing Lane Detection Reliability of Automated Vehicles in Complex Road Environments, Chen Chai, Tao Liu, Jiaqi Liu, Xu Cao, Yuchen Hu, Qingtao Li, Transportation Research Record.

🎖 Honors and Awards

2024.10 National Scholarship, Ministry of Education of China
2024.08 IEEE ITSC 2024 Travel Award
2023.12 Jingchuan Scholarship
2023.01 Dean’s Scholarship, College of Transportation Engineering, Tongji University (Only one)
2022.10 Shanghai University Student Annual Character (Nomination Award)!
2022.06 Outstanding Graduates from Shanghai(Top 1%).
2021.12 National Scholarship, Ministry of Education of China
2021.05 Tongji University Pursuit of Excellence Award (3/4450) !
2020.11 The only Grand Prize in China Reverse Logistics Design Competition (1 / 329)
2020.10 Best paper award of Contemporary Undergraduate Mathematical Contest in Modeling (CUMCM) (3/ 42000+) !
2020.10 First Prize in China Transportation Science and Technology Competition
2020.10 First Prize in the Shanghai College Students Transportation Innovation Competition
2020.6 First Prize in the 19th Transportation Science and Technology Competition at Tongji University
2020.5 First Prize in Tongji University Mathematical Modeling Contest
2019.12 National Scholarship, Ministry of Education of China
2019-2022 Outstanding Student Award at Tongji University
2019-2022 Tang Zhongying Moral Education Scholarship
2019-2022 Undergraduate Social Activity Scholarship at Tongji University

📖 Educations

2022.09 - now, Master of Traffic Engineering, Tongji University, Shanghai, China
2018.09 - 2022.06, Bachelor of Traffic Engineering, Tongji University, Shanghai, China (GPA: 4.89/5, rank: 1/163)

📚 Academic Services

Reviews

Journal Reviewer: IEEE Transactions on Intelligent Vehicles (TIV), IEEE Transactions on Intelligent Transportation Systems (TITS), IEEE Transactions on Neural Networks and Learning(TNNLS),IEEE Robotics and Automation Letters (RA-L), Journal of Field Robotics, IEEE Transactions on Industrial Informatics (TII), IEEE Transactions on Vehicular Technology (TVT), IEEE Transactions on Automation Science and Engineering (TASE), IEEE Internet of Things Journal, Nonlinear Dynamics, Journal of Advanced Transportation
Conference Reviewer: ICRA, ITSC, CVCI, TRB

Jiaqi Liu

🔥 News

📝 Publications

🎖 Honors and Awards

📖 Educations

📚 Academic Services

Reviews

Mentoring

Ph.D. students

Undergraduate students