The Error is the Feature: how to Forecast Lightning using a Model Prediction Error

11/23/2018
by   Christian Schön, et al.
8

Despite the progress throughout the last decades, weather forecasting is still a challenging and computationally expensive task. Most models which are currently operated by meteorological services around the world rely on numerical weather prediction, a system based on mathematical algorithms describing physical effects. Recent progress in artificial intelligence however demonstrates that machine learning can be successfully applied to many research fields, especially areas dealing with big data that can be used for training. Current approaches to predict thunderstorms often focus on indices describing temperature differences in the atmosphere. If these indices reach a critical threshold, the forecast system emits a thunderstorm warning. Other meteorological systems such as radar and lightning detection systems are added for a more precise prediction. This paper describes a new approach to the prediction of lightnings based on machine learning rather than complex numerical computations. The error of optical flow algorithms applied to images of meteorological satellites is interpreted as a sign for convection potentially leading to thunderstorms. These results are used as the base for the feature generation phase incorporating different convolution steps. Tree classifier models are then trained to predict lightnings within the next few hours (called nowcasting) based on these features. The evaluation section compares the predictive power of the different models and the impact of different features on the classification result.

READ FULL TEXT

page 6

page 11

page 15

research
12/07/2022

Physics-constrained deep learning postprocessing of temperature and humidity

Weather forecasting centers currently rely on statistical postprocessing...
research
05/11/2020

A review of radar-based nowcasting of precipitation and applicable machine learning techniques

A 'nowcast' is a type of weather forecast which makes predictions in the...
research
12/03/2019

Make Thunderbolts Less Frightening – Predicting Extreme Weather Using Deep Learning

Forecasting severe weather conditions is still a very challenging and co...
research
06/13/2020

A generative adversarial network approach to (ensemble) weather prediction

We use a conditional deep convolutional generative adversarial network t...
research
01/18/2020

Forecasting Corn Yield with Machine Learning Ensembles

The emerge of new technologies to synthesize and analyze big data with h...
research
09/11/2020

Supervised learning for the prediction of firm dynamics

Thanks to the increasing availability of granular, yet high-dimensional,...
research
03/24/2019

Deep recommender engine based on efficient product embeddings neural pipeline

Predictive analytics systems are currently one of the most important are...

Please sign up or login with your details

Forgot password? Click here to reset