Cheng, Chih-Hong (Chalmers University of Technology), Stöckel, Paul (Universität Hildesheim), Zhao, Xingyu (University of Warwick)

Instance-Level Safety-Aware Fidelity of Synthetic Data and Its Calibration

Scheduled for presentation during the Regular Session "Synthetic datasets in perception" (ThBT4), Thursday, September 26, 2024, 14:30−14:50, Salon 7

2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC), September 24- 27, 2024, Edmonton, Canada

This information is tentative and subject to change. Compiled on October 3, 2024

Abstract

Modeling and calibrating the fidelity of synthetic data is paramount in shaping the future of safe and reliable self-driving technology by offering a cost-effective and scalable alternative to real-world data collection. We focus on its role in safety-critical applications, introducing four types of instance-level fidelity that go beyond mere visual input characteristics. The aim is to ensure that applying testing on synthetic data can reveal real-world safety issues, and the absence of safety-critical issues when testing under synthetic data can provide a strong safety guarantee in real-world behavior. We suggest an optimization method to refine the synthetic data generator, reducing fidelity gaps identified by deep learning components. Experiments show this tuning enhances the correlation between safety-critical errors in synthetic and real data.