An Attention-Based Multilayer GRU Model for Multistep-Ahead Short-Term Load Forecasting

Sensors (Basel). 2021 Feb 26;21(5):1639. doi: 10.3390/s21051639.

Abstract

Recently, multistep-ahead prediction has attracted much attention in electric load forecasting because it can deal with sudden changes in power consumption caused by various events such as fire and heat wave for a day from the present time. On the other hand, recurrent neural networks (RNNs), including long short-term memory and gated recurrent unit (GRU) networks, can reflect the previous point well to predict the current point. Due to this property, they have been widely used for multistep-ahead prediction. The GRU model is simple and easy to implement; however, its prediction performance is limited because it considers all input variables equally. In this paper, we propose a short-term load forecasting model using an attention based GRU to focus more on the crucial variables and demonstrate that this can achieve significant performance improvements, especially when the input sequence of RNN is long. Through extensive experiments, we show that the proposed model outperforms other recent multistep-ahead prediction models in the building-level power consumption forecasting.

Keywords: attention mechanism; building electrical energy consumption forecasting; gated recurrent unit; multistep-ahead forecasting; short-term load forecasting.