Jin, Guizhe (Tongji University), Li, Zhuoren (Tongji University), Leng, Bo (Tongji University), Han, Wei (Tongji University), Lu, Xiong (Tongji Unviersity), Hu, Jia (Tongji University), Li, Nan (University of Michigan, Ann Arbor)

Stability Enhanced Hierarchical Reinforcement Learning for Autonomous Driving with Parameterized Trajectory Action

Scheduled for presentation during the Invited Session "Data-driven and Learning-based Control Techniques for Intelligent Vehicles" (FrAT1), Friday, September 27, 2024, 11:30−11:50, Salon 1

2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC), September 24- 27, 2024, Edmonton, Canada

This information is tentative and subject to change. Compiled on October 14, 2024

Abstract

Reinforcement Learning (RL) has become a potential method for autonomous driving to adapt to complex driving environments with high flexibility. However, the popular RL paradigm directly outputting the vehicle control commands makes the future motion with fluctuation. To improve the driving behavior stability of RL method while ensuring the motion flexibility, this paper proposes a stability enhanced hierarchical reinforcement learning method based on parameterized trajectory action (RL-PTA). It offers feasible driving path in the long horizon and real-time control commands in the short horizon simultaneously. The RL agent actively contributes to path generation with discrete-continuous hybrid parameter actions, and the parameterized action space also ensures optimal consistency of the hybrid output. The experiment results show that the proposed method can generate flexible and stable lane-change driving behavior, thereby improving the efficiency and safety for autonomous driving.