RECOWNs: Probabilistic Circuits for Trustworthy Time Series Forecasting

06/08/2021
by   Nils Thoma, et al.
20

Time series forecasting is a relevant task that is performed in several real-world scenarios such as product sales analysis and prediction of energy demand. Given their accuracy performance, currently, Recurrent Neural Networks (RNNs) are the models of choice for this task. Despite their success in time series forecasting, less attention has been paid to make the RNNs trustworthy. For example, RNNs can not naturally provide an uncertainty measure to their predictions. This could be extremely useful in practice in several cases e.g. to detect when a prediction might be completely wrong due to an unusual pattern in the time series. Whittle Sum-Product Networks (WSPNs), prominent deep tractable probabilistic circuits (PCs) for time series, can assist an RNN with providing meaningful probabilities as uncertainty measure. With this aim, we propose RECOWN, a novel architecture that employs RNNs and a discriminant variant of WSPNs called Conditional WSPNs (CWSPNs). We also formulate a Log-Likelihood Ratio Score as better estimation of uncertainty that is tailored to time series and Whittle likelihoods. In our experiments, we show that RECOWNs are accurate and trustworthy time series predictors, able to "know when they do not know".

READ FULL TEXT
research
03/29/2017

Position-based Content Attention for Time Series Forecasting with Sequence-to-sequence RNNs

We propose here an extended attention model for sequence-to-sequence rec...
research
07/28/2023

A Distance Correlation-Based Approach to Characterize the Effectiveness of Recurrent Neural Networks for Time Series Forecasting

Time series forecasting has received a lot of attention with recurrent n...
research
11/21/2020

A Worrying Analysis of Probabilistic Time-series Models for Sales Forecasting

Probabilistic time-series models become popular in the forecasting field...
research
04/07/2015

Bidirectional Recurrent Neural Networks as Generative Models - Reconstructing Gaps in Time Series

Bidirectional recurrent neural networks (RNN) are trained to predict bot...
research
08/29/2018

Correlated Time Series Forecasting using Deep Neural Networks: A Summary of Results

Cyber-physical systems often consist of entities that interact with each...
research
09/27/2022

Retrieval Based Time Series Forecasting

Time series data appears in a variety of applications such as smart tran...
research
09/30/2020

Modelisation of competition between times series

Competition between times series arises naturally in sales forecasting o...

Please sign up or login with your details

Forgot password? Click here to reset