ONE-NAS: An Online NeuroEvolution based Neural Architecture Search for Time Series Forecasting

by   Zimeng Lyu, et al.

Time series forecasting (TSF) is one of the most important tasks in data science, as accurate time series (TS) predictions can drive and advance a wide variety of domains including finance, transportation, health care, and power systems. However, real-world utilization of machine learning (ML) models for TSF suffers due to pretrained models being able to learn and adapt to unpredictable patterns as previously unseen data arrives over longer time scales. To address this, models must be periodically retained or redesigned, which takes significant human and computational resources. This work presents the Online NeuroEvolution based Neural Architecture Search (ONE-NAS) algorithm, which to the authors' knowledge is the first neural architecture search algorithm capable of automatically designing and training new recurrent neural networks (RNNs) in an online setting. Without any pretraining, ONE-NAS utilizes populations of RNNs which are continuously updated with new network structures and weights in response to new multivariate input data. ONE-NAS is tested on real-world large-scale multivariate wind turbine data as well a univariate Dow Jones Industrial Average (DJIA) dataset, and is shown to outperform traditional statistical time series forecasting, including naive, moving average, and exponential smoothing methods, as well as state of the art online ARIMA strategies.


Online Evolutionary Neural Architecture Search for Multivariate Non-Stationary Time Series Forecasting

Time series forecasting (TSF) is one of the most important tasks in data...

An Intelligent End-to-End Neural Architecture Search Framework for Electricity Forecasting Model Development

Recent years have witnessed an exponential growth in developing deep lea...

POPNASv3: a Pareto-Optimal Neural Architecture Search Solution for Image and Time Series Classification

The automated machine learning (AutoML) field has become increasingly re...

Tab2vox: CNN-Based Multivariate Multilevel Demand Forecasting Framework by Tabular-To-Voxel Image Conversion

Since demand is influenced by a wide variety of causes, it is necessary ...

Continuous Ant-Based Neural Topology Search

This work introduces a novel, nature-inspired neural architecture search...

Event Classification with Multi-step Machine Learning

The usefulness and value of Multi-step Machine Learning (ML), where a ta...

Noisy Heuristics NAS: A Network Morphism based Neural Architecture Search using Heuristics

Network Morphism based Neural Architecture Search (NAS) is one of the mo...

Please sign up or login with your details

Forgot password? Click here to reset