ITSC 2025 Paper Abstract

Close

Paper FR-LM-T44.5

Singh, Abhimanyu Pratap (Indian Institute of Technology, Delhi), Lim, Kai Li (The University of Western Australia), Kanchwala, Husain (Indian Institute of Technology Delhi), Yildirimoglu, Mehmet (University of Queensland)

Koopman-Driven Predictive Modeling of Vehicle-Driver Interaction

Scheduled for presentation during the Regular Session "S44a-Human Factors and Human Machine Interaction in Automated Driving" (FR-LM-T44), Friday, November 21, 2025, 11:50−12:10, Currumbin

2025 IEEE 28th International Conference on Intelligent Transportation Systems (ITSC), November 18-21, 2025, Gold Coast, Australia

This information is tentative and subject to change. Compiled on October 18, 2025

Keywords Driver Behavior Monitoring and Feedback Systems for Semi-autonomous Vehicles, Human-Machine Interaction Systems for Enhanced Driver Assistance and Safety, Cooperative Driving Systems and Vehicle Coordination in Multi-vehicle Scenarios

Abstract

This work uses Koopman operator theory to present a data-driven, control-oriented framework for vehicle and driver action prediction. Sensor data and visual context can now be included in vehicle control systems thanks to recent automotive sensing, computation, and machine learning developments. Building on these advances, we suggest a Koopman-based method whereby the nonlinear interactions between the driver, vehicle, and surroundings are raised into a higher-dimensional space from where they can be modelled with linear operators. Using a ResNet-18 based feature extractor, our approach combines visual cues extracted from RGBD images with time-delayed vehicle state data, capturing dynamic and contextual information about driver behaviour. Using extended dynamic mode decomposition, separate Koopman operators are learnt for vehicle states and driver actions, enabling multi-step prediction and the use of linear control strategies. Validation with unseen data shows that adding visual context to vehicle states greatly increases driver response prediction accuracy over models that depend just on time-series data. By allowing automation agents to predict driver actions, the proposed framework helps build shared control systems, improving cooperation and safety in intelligent vehicle applications.

 

 

All Content © PaperCept, Inc.


This site is protected by copyright and trademark laws under US and International law.
All rights reserved. © 2002-2025 PaperCept, Inc.
Page generated 2025-10-18  21:25:24 PST  Terms of use