A Statistics and Deep Learning Hybrid Method for Multivariate Time Series Forecasting and Mortality Modeling

by   Thabang Mathonsi, et al.

Hybrid methods have been shown to outperform pure statistical and pure deep learning methods at forecasting tasks and quantifying the associated uncertainty with those forecasts (prediction intervals). One example is Exponential Smoothing Recurrent Neural Network (ES-RNN), a hybrid between a statistical forecasting model and a recurrent neural network variant. ES-RNN achieves a 9.4% improvement in absolute error in the Makridakis-4 Forecasting Competition. This improvement and similar outperformance from other hybrid models have primarily been demonstrated only on univariate datasets. Difficulties with applying hybrid forecast methods to multivariate data include (i) the high computational cost involved in hyperparameter tuning for models that are not parsimonious, (ii) challenges associated with auto-correlation inherent in the data, as well as (iii) complex dependency (cross-correlation) between the covariates that may be hard to capture. This paper presents Multivariate Exponential Smoothing Long Short Term Memory (MES-LSTM), a generalized multivariate extension to ES-RNN, that overcomes these challenges. MES-LSTM utilizes a vectorized implementation. We test MES-LSTM on several aggregated coronavirus disease of 2019 (COVID-19) morbidity datasets and find our hybrid approach shows consistent, significant improvement over pure statistical and deep learning methods at forecast accuracy and prediction interval construction.


page 15

page 18

page 21


Statistics and Deep Learning-based Hybrid Model for Interpretable Anomaly Detection

Hybrid methods have been shown to outperform pure statistical and pure d...

ES-dRNN: A Hybrid Exponential Smoothing and Dilated Recurrent Neural Network Model for Short-Term Load Forecasting

Short-term load forecasting (STLF) is challenging due to complex time se...

Multivariate Anomaly Detection based on Prediction Intervals Constructed using Deep Learning

It has been shown that deep learning models can under certain circumstan...

Tropical Cyclone Track Forecasting using Fused Deep Learning from Aligned Reanalysis Data

The forecast of tropical cyclone trajectories is crucial for the protect...

Contextually Enhanced ES-dRNN with Dynamic Attention for Short-Term Load Forecasting

In this paper, we propose a new short-term load forecasting (STLF) model...

Lessons Learned Applying Deep Learning Approaches to Forecasting Complex Seasonal Behavior

Deep learning methods have gained popularity in recent years through the...

Please sign up or login with your details

Forgot password? Click here to reset