Sielemann, Anne (Fraunhofer IOSB), Loercher, Lena (Fraunhofer IPA), Schumacher, Max-Lion (Fraunhofer IPA), Wolf, Stefan (KIT), Roschani, Masoud (Fraunhofer IOSB), Jens, Ziehn (Fraunhofer IOSB), Beyerer, Jürgen (Fraunhofer Institute of Optronics, Systems Technologies and Imag)

Synset Signset Germany: A Synthetic Dataset for German Traffic Sign Recognition

Scheduled for presentation during the Regular Session "Synthetic datasets in perception" (ThBT4), Thursday, September 26, 2024, 15:30−15:50, Salon 7

2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC), September 24- 27, 2024, Edmonton, Canada

This information is tentative and subject to change. Compiled on October 14, 2024

Abstract

In this paper, we present a synthesis pipeline and dataset for training / testing data in the task of traffic sign recognition that combines the advantages of data-driven and analytical modeling: GAN-based texture generation enables data-driven dirt and wear artifacts, rendering unique and realistic traffic sign surfaces, while the analytical scene modulation achieves physically correct lighting and allows detailed parameterization. In particular, the latter opens up applications in the context of explainable AI (XAI) and robustness tests due to the possibility of evaluating the sensitivity to parameter changes, which we demonstrate with experiments. Our resulting synthetic traffic sign recognition dataset Synset Signset Germany contains a total of 105,500 images of 211 different German traffic sign classes, including newly published (2020) and thus comparatively rare traffic signs. In addition to a mask and a segmentation image, we also provide extensive metadata including the stochastically selected environment and imaging effect parameters for each image. We evaluate the degree of realism of Synset Signset Germany on the real-world German Traffic Sign Recognition Benchmark (GTSRB) and in comparison to CATERED, a state-of-the-art synthetic traffic sign recognition dataset.