Ghaleb, Taher
A two-stage hybrid deep learning framework with reinforce-learned temporal dilated convolutions for predicting vehicle left-turn speed at pedestrian crossings
Predicting vehicle speed at critical road segments, such as pedestrian crossings during left-turn maneuvers at signalized intersections, is essential for improving traffic safety and supporting autonomous driving systems. This thesis presents a novel two-stage hybrid deep learning framework enhanced with reinforcement learning to forecast vehicle left-turn speed at pedestrian crossings.
Using a multivariate time series dataset of vehicle speed and acceleration, the final three seconds of data are intentionally removed to simulate real-world decision-making prior to reaching pedestrian crossings. In stage one, a Convolutional Neural Network (CNN) imputes the removed values. Stage two uses the imputed data to forecast speed, combining Temporal Convolutional Networks (TCNs) and Long Short-Term Memory (LSTM) networks as feature extractors, followed by a Random Forest Regressor (RFR) for robust speed predictions.
Reinforcement learning is employed to dynamically adjusts the TCN's dilation rate, improving temporal pattern capture. Experimental results show the proposed framework outperforms standalone, hybrid, and state-of-the-art models.
Author Keywords: Data Imputation, Dynamic Dilation, Left-Turn Maneuver, Reinforcement Learning, Temporal Convolutional Network, Time series Forecasting