Han, Zhixuan (Beihang university), Chen, Peng (Beihang University), zhou, bin (BUAA), Yu, Guizhen (Beihang University)

A Truck Path Tracking Controller Based on Combined Pure Pursuit and Deep Reinforcement Learning

Scheduled for presentation during the Regular Session "Control of heavy vehicles" (FrAT4), Friday, September 27, 2024, 10:50−11:10, Salon 7

2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC), September 24- 27, 2024, Edmonton, Canada

This information is tentative and subject to change. Compiled on December 26, 2024

Abstract

Path tracking is a crucial task for autonomous vehicles. Traditional control methods often struggle with the nonlinear and coupled characteristics of systems, making it difficult to establish accurate models. By contrast, deep reinforcement learning approaches eliminate the need for complex mathematical models by learning path tracking strategies from sensing data, although they suffer from poor interpretability. Therefore, solely relying on either traditional control methods or deep reinforcement learning poses inherent limitations. This study combines the traditional pure pursuit (PP) method with the proximal policy optimization (PPO) algorithm from deep reinforcement learning to construct a truck controller architecture collaboratively. The PP method serves as the foundational control strategy, while the PPO algorithm is utilized to optimize control adjustments, enhancing control accuracy. In the state design, a look-ahead mechanism and its influence on speed were considered. Furthermore, a PreScan–Simulink–ROS software-in-the-loop testing platform was established to simulate the dynamics of trucks. Extensive simulation experiments were conducted, and the results demonstrated the effectiveness of our approach.