EvoSTS Forecasting: Evolutionary Sparse Time-Series Forecasting

by   Ethan Jacob Moyer, et al.

In this work, we highlight our novel evolutionary sparse time-series forecasting algorithm also known as EvoSTS. The algorithm attempts to evolutionary prioritize weights of Long Short-Term Memory (LSTM) Network that best minimize the reconstruction loss of a predicted signal using a learned sparse coded dictionary. In each generation of our evolutionary algorithm, a set number of children with the same initial weights are spawned. Each child undergoes a training step and adjusts their weights on the same data. Due to stochastic back-propagation, the set of children has a variety of weights with different levels of performance. The weights that best minimize the reconstruction loss with a given signal dictionary are passed to the next generation. The predictions from the best-performing weights of the first and last generation are compared. We found improvements while comparing the weights of these two generations. However, due to several confounding parameters and hyperparameter limitations, some of the weights had negligible improvements. To the best of our knowledge, this is the first attempt to use sparse coding in this way to optimize time series forecasting model weights, such as those of an LSTM network.


page 1

page 2

page 3

page 4


Forecasting Across Time Series Databases using Long Short-Term Memory Networks on Groups of Similar Series

With the advent of Big Data, nowadays in many applications databases con...

Pattern-based Long Short-term Memory for Mid-term Electrical Load Forecasting

This work presents a Long Short-Term Memory (LSTM) network for forecasti...

An Attention Free Long Short-Term Memory for Time Series Forecasting

Deep learning is playing an increasingly important role in time series a...

DVS: Deep Visibility Series and its Application in Construction Cost Index Forecasting

Time series forecasting has always been a hot spot in scientific researc...

Long Short-term Cognitive Networks

In this paper, we present a recurrent neural system named Long Short-ter...

A Novel Method Combines Moving Fronts, Data Decomposition and Deep Learning to Forecast Intricate Time Series

A univariate time series with high variability can pose a challenge even...

Please sign up or login with your details

Forgot password? Click here to reset