Safe Reinforcement Learning-Based Eco-Driving Control for Mixed Traffic Flows With Disturbances

扫码查看

原文链接

NETL
NSTL
IEEE

外文摘要：This paper presents a safe learning-based eco-driving framework tailored for mixed traffic flows, which aims to optimize energy efficiency while guaranteeing system constraints during real-system operations. Even though reinforcement learning (RL) is capable of optimizing energy efficiency in intricate environments, it is challenged by safety requirements during both the training and deployment stages. The lack of safety guarantees impedes the application of RL to real-world problems. Compared with RL, model predicted control (MPC) can handle constrained dynamics systems, ensuring safe driving. However, the major challenges lie in complicated eco-driving tasks and the presence of disturbances, which pose difficulties for MPC design and constraint satisfaction. To address these limitations, the proposed framework incorporates the tube-based enhanced MPC (RMPC) to ensure the safe execution of the RL policy under disturbances, thereby improving the control robustness. RL not only optimizes the energy efficiency of the connected and automated vehicle in mixed traffic but also handles more uncertain scenarios, in which the energy consumption of the human-driven vehicle and its diverse and stochastic driving behaviors are considered in the optimization framework. Simulation results demonstrate that the proposed algorithm achieves an average improvement of 10.88% in holistic energy efficiency compared to the RMPC technique, while effectively preventing inter-vehicle collisions when compared to the RL algorithm.

外文关键词：

SafetyEnergy efficiencyEnergy consumptionOptimizationTrainingRobustnessDriver behaviorStochastic processesElectronic mailUncertainty

作者：

Ke Lu、Dongjun Li、Qun Wang、Kaidi Yang、Lin Zhao、Ziyou Song

展开 >

作者单位：

Department of Mechanical Engineering, National University of Singapore, Lower Kent Ridge Rd, Singapore|School of Automation Science and Engineering, South China University of Technology, Guangzhou, China

Department of Mechanical Engineering, National University of Singapore, Lower Kent Ridge Rd, Singapore

Department of Civil and Environmental Engineering, National University of Singapore, Lower Kent Ridge Rd, Singapore

Department of Electrical and Computer Engineering, National University of Singapore, Lower Kent Ridge Rd, Singapore

展开 >

出版年：

2025

DOI：

10.1109/TITS.2025.3544812

IEEE transactions on intelligent transportation systems

ISSN：

年,卷(期)：2025.26(4)