Fragkedaki, Kleio (KTH Royal Institute of Technology), Jiang, Frank J. (KTH Royal Institute of Technology), Johansson, Karl H. (KTH Royal Institute of Technology), Mårtensson, Jonas (KTH Royal Institute of Technology)

Pedestrian Motion Prediction Using Transformer-Based Behavior Clustering and Data-Driven Reachability Analysis

Scheduled for presentation during the Invited Session "Learning-powered and Knowledge-driven Autonomous Driving II" (ThBT1), Thursday, September 26, 2024, 15:10−15:30, Salon 1

2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC), September 24- 27, 2024, Edmonton, Canada

This information is tentative and subject to change. Compiled on October 8, 2024

Abstract

In this work, we present a transformer-based framework for predicting future pedestrian states based on clustered historical trajectory data. In previous studies, researchers propose enhancing pedestrian trajectory predictions by using manually crafted labels to categorize pedestrian behaviors and intentions. However, these approaches often only capture a limited range of pedestrian behaviors and introduce human bias into the predictions. To alleviate the dependency on manually crafted labels, we utilize a transformer encoder coupled with hierarchical density-based clustering to automatically identify diverse behavior patterns, and use these clusters in data-driven reachability analysis. By using a transformer-based approach, we seek to enhance the representation of pedestrian trajectories and uncover characteristics or features that are subsequently used to group trajectories into different “behavior” clusters. We show that these behavior clusters can be used with data-driven reachability analysis, yielding an end-to-end data-driven approach to predicting the future motion of pedestrians. We train and evaluate our approach on a real pedestrian dataset, showcasing its effectiveness in forecasting pedestrian movements.