Transfer Learning in Deep Learning Models for Building Load Forecasting: Case of Limited Data

by   Menna Nawar, et al.

Precise load forecasting in buildings could increase the bill savings potential and facilitate optimized strategies for power generation planning. With the rapid evolution of computer science, data-driven techniques, in particular the Deep Learning models, have become a promising solution for the load forecasting problem. These models have showed accurate forecasting results; however, they need abundance amount of historical data to maintain the performance. Considering the new buildings and buildings with low resolution measuring equipment, it is difficult to get enough historical data from them, leading to poor forecasting performance. In order to adapt Deep Learning models for buildings with limited and scarce data, this paper proposes a Building-to-Building Transfer Learning framework to overcome the problem and enhance the performance of Deep Learning models. The transfer learning approach was applied to a new technique known as Transformer model due to its efficacy in capturing data trends. The performance of the algorithm was tested on a large commercial building with limited data. The result showed that the proposed approach improved the forecasting accuracy by 56.8 case of conventional deep learning where training from scratch is used. The paper also compared the proposed Transformer model to other sequential deep learning models such as Long-short Term Memory (LSTM) and Recurrent Neural Network (RNN). The accuracy of the transformer model outperformed other models by reducing the root mean square error to 0.009, compared to LSTM with 0.011 and RNN with 0.051.


page 1

page 3


TgDLF2.0: Theory-guided deep-learning for electrical load forecasting via Transformer and transfer learning

Electrical energy is essential in today's society. Accurate electrical l...

BuildingsBench: A Large-Scale Dataset of 900K Buildings and Benchmark for Short-Term Load Forecasting

Short-term forecasting of residential and commercial building energy con...

Differential Evolution Algorithm based Hyper-Parameters Selection of Transformer Neural Network Model for Load Forecasting

Accurate load forecasting plays a vital role in numerous sectors, but ac...

Development of Deep Transformer-Based Models for Long-Term Prediction of Transient Production of Oil Wells

We propose a novel approach to data-driven modeling of a transient produ...

An Adaptive Deep Learning Framework for Day-ahead Forecasting of Photovoltaic Power Generation

Accurate forecasts of photovoltaic power generation (PVPG) are essential...

Clustering Enabled Few-Shot Load Forecasting

While the advanced machine learning algorithms are effective in load for...

A Deep Learning Approach to Dst Index Prediction

The disturbance storm time (Dst) index is an important and useful measur...

Please sign up or login with your details

Forgot password? Click here to reset