Zhang, Yuanyuan (Hong Kong Polytechnic University), Wen, Weisong (Hong Kong Polytechnic University), Yan, Penggao (The Hong Kong Polytechnic University)

Safe-Assured Learning-Based Deep SE(3) Motion Joint Planning and Control for UAV Interactions with Dynamic Environments

Scheduled for presentation during the Regular Session "Unmanned aerial vehicles" (FrBT11), Friday, September 27, 2024, 13:30−13:50, Salon 19

2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC), September 24- 27, 2024, Edmonton, Canada

This information is tentative and subject to change. Compiled on December 26, 2024

Abstract

In the era of low-altitude economy, ensuring a safe and agile flight of Unmanned aerial vehicles (UAVs) through the obstacle environment is significant to expanding their interactive applications. Deep reinforcement learning (DRL) based methods have demonstrated promising performance in achieving reliable navigation and precise task execution for UAVs. However, due to its trial-and-error search characteristic, DRL fails to balance safety robustness while pursuing agile performance, especially during training. Moreover, this problem is exacerbated due to the existence of uncertain observation noise in dynamic environments. To address this issue, this paper proposes a safe-assured learning-based deep SE(3) joint planning and control framework. This framework firstly achieves high-level safety decision-making, online complex motion planning, and control for UAVs by seamlessly integrating DRL with nonlinear model predictive control (NMPC). Secondly, this paper constructs a safe stochastic reachability certificate to calculate the stochastic forward reachable set of planned trajectories under uncertain conditions to perform specific safe collision probability checks. This safety foresight mechanism adaptively selects belief space actions from planned actions to interact with the environment, further improving safety while reducing training time. In the simulation of the agile traversal of a fast-moving gate by UAV, we demonstrate that the proposed method can effectively reduce total collision incidents and training time, thereby enhancing training safety and efficiency to a large extent.