Nonlinear Traffic Prediction as a Matrix Completion Problem with Ensemble Learning

by   Wenqing Li, et al.

We focus on short-term traffic forecasting for traffic operations management. Specifically, we focus on forecasting traffic network sensor states in high-resolution (second-by-second). Most work on traffic forecasting has focused on predicting aggregated traffic variables, typically over intervals that are no shorter than 5 minutes. The data resolution required for traffic operations is challenging since high-resolution data exhibit heavier oscillations and precise patterns are harder to capture. We propose a (big) data-driven methodology for this purpose. Our contributions can be summarized as offering three major insights: first, we show how the forecasting problem can be modeled as a matrix completion problem. Second, we employ a block-coordinate descent algorithm and demonstrate that the algorithm converges in sub-linear time to a block coordinate-wise optimizer. This allows us to capitalize on the “bigness” of high-resolution data in a computationally feasible way. Third, we develop an adaptive boosting (or ensemble learning) approach to reduce the training error to within any arbitrary error threshold. The latter utilizes past days so that the boosting can be interpreted as capturing periodic patterns in the data. The performance of the proposed method is analyzed theoretically and tested empirically using a real-world high-resolution traffic dataset from Abu Dhabi, UAE. Our experimental results show that the proposed method outperforms other state-of-the-art algorithms.


Short-Term Traffic Forecasting Using High-Resolution Traffic Data

This paper develops a data-driven toolkit for traffic forecasting using ...

Matrix Completion under Interval Uncertainty

Matrix completion under interval uncertainty can be cast as matrix compl...

SwinRDM: Integrate SwinRNN with Diffusion Model towards High-Resolution and High-Quality Weather Forecasting

Data-driven medium-range weather forecasting has attracted much attentio...

A Slow-Shifting Concerned Machine Learning Method for Short-term Traffic Flow Forecasting

The ability to predict traffic flow over time for crowded areas during r...

Deep-Ensemble-Based Uncertainty Quantification in Spatiotemporal Graph Neural Networks for Traffic Forecasting

Deep-learning-based data-driven forecasting methods have produced impres...

Towards forecast techniques for business analysts of large commercial data sets using matrix factorization methods

This research article suggests that there are significant benefits in ex...

Incorporating Kinematic Wave Theory into a Deep Learning Method for High-Resolution Traffic Speed Estimation

We propose a kinematic wave based Deep Convolutional Neural Network (Dee...

Please sign up or login with your details

Forgot password? Click here to reset