Improving Sample Efficiency of Deep Learning Models in Electricity Market

by   Guangchun Ruan, et al.

The superior performance of deep learning relies heavily on a large collection of sample data, but the data insufficiency problem turns out to be relatively common in global electricity markets. How to prevent overfitting in this case becomes a fundamental challenge when training deep learning models in different market applications. With this in mind, we propose a general framework, namely Knowledge-Augmented Training (KAT), to improve the sample efficiency, and the main idea is to incorporate domain knowledge into the training procedures of deep learning models. Specifically, we propose a novel data augmentation technique to generate some synthetic data, which are later processed by an improved training strategy. This KAT methodology follows and realizes the idea of combining analytical and deep learning models together. Modern learning theories demonstrate the effectiveness of our method in terms of effective prediction error feedbacks, a reliable loss function, and rich gradient noises. At last, we study two popular applications in detail: user modeling and probabilistic price forecasting. The proposed method outperforms other competitors in all numerical tests, and the underlying reasons are explained by further statistical and visualization results.


page 1

page 3

page 5

page 7

page 8


Forecasting day-ahead electricity prices in Europe: the importance of considering market integration

Motivated by the increasing integration among electricity markets, in th...

Forecasting Market Prices using DL with Data Augmentation and Meta-learning: ARIMA still wins!

Deep-learning techniques have been successfully used for time-series for...

Adversarial Deep Hedging: Learning to Hedge without Price Process Modeling

Deep hedging is a deep-learning-based framework for derivative hedging i...

Textual Data Augmentation for Patient Outcomes Prediction

Deep learning models have demonstrated superior performance in various h...

AI Driven Near Real-time Locational Marginal Pricing Method: A Feasibility and Robustness Study

Accurate price predictions are essential for market participants in orde...

Deep Learning Models on CPUs: A Methodology for Efficient Training

GPUs have been favored for training deep learning models due to their hi...

AdaSelection: Accelerating Deep Learning Training through Data Subsampling

In this paper, we introduce AdaSelection, an adaptive sub-sampling metho...

Please sign up or login with your details

Forgot password? Click here to reset