Wachtel Granado, Diogo (Technische Hochschule Ingolstadt), Tasabat, Sinan (Technische Hochschule Ingolstadt), Rothmeier, Thomas (University of Applied Sciences Ingolstadt), Cristófoli Duarte, Leticia (Technische Hochschule Ingolstadt), Werner Huber, Werner (Technische Hochschule Ingolstadt)

Exploring Synthetic Radar Data and Deep Learning for Road User Classification in Autonomous Vehicles

Scheduled for presentation during the Poster Session "Modeling, Simulation, and Control of Pedestrians and Cyclists II" (ThAT14), Thursday, September 26, 2024, 10:30−12:30, Foyer

2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC), September 24- 27, 2024, Edmonton, Canada

This information is tentative and subject to change. Compiled on October 7, 2024

Abstract

This work investigates enhancing road safety and efficiency in autonomous vehicles through radar sensors and deep neural networks with synthetic data. It focuses on machine perception using image-based algorithms and Deep Convolutional Neural Networks (DCNNs) to detect and classify road users accurately with micro-Doppler images. It explores the effectiveness of ray tracing technology and the HFSS SBR+ tool from ANSYS for realistic radar simulations in dynamic environments. The research demonstrates the capability of these technologies in classifying pedestrians, cyclists, and vehicles using both simulated and real-world data. This work contributes to autonomous vehicle technology by showcasing advanced radar simulations and deep learning methods for improved road safety and vehicle efficiency. Augmenting the dataset with synthetic data significantly enhances car classification accuracy by nearly 20%, with minimal impact on the classification of other objects. Furthermore, the inclusion of synthetic data has shown to be highly beneficial, improving the model's overall accuracy by at least 10% across all training datasets. The trained CNN model with the combined dataset, synthetically generated data, and real data demonstrated a robust solution, achieving an overall accuracy of approximately 96% with the distinction that this study introduced the synthetic generation of objects.