Ultra short term power load forecasting based on the fusion of Seq2Seq BiLSTM and multi head attention mechanism

PLoS One. 2024 Mar 22;19(3):e0299632. doi: 10.1371/journal.pone.0299632. eCollection 2024.

Abstract

Ultra-short-term power load forecasting is beneficial to improve the economic efficiency of power systems and ensure the safe and stable operation of power grids. As the volatility and randomness of loads in power systems, make it difficult to achieve accurate and reliable power load forecasting, a sequence-to-sequence based learning framework is proposed to learn feature information in different dimensions synchronously. Convolutional Neural Networks(CNN) Combined with Bidirectional Long Short Term Memory(BiLSTM) Networks is constructed in the encoder to extract the correlated timing features embedded in external factors affecting power loads. The parallel BiLSTM network is constructed in the decoder to mine the power load timing information in different regions separately. The multi-headed attention mechanism is introduced to fuse the BiLSTM hidden layer state information in different components to further highlight the key information representation. The load forecastion results in different regions are output through the fully connected layer. The model proposed in this paper has the advantage of high forecastion accuracy through the example analysis of real power load data.

MeSH terms

  • Computer Systems*
  • Forecasting
  • Learning*
  • Memory, Long-Term
  • Neural Networks, Computer

Grants and funding

National Natural Science Foundation of China (Y.F. GOU, C GUO, R.S. QIN; NO.52367002), Key Project of Yunnan Provincial Joint Foundation (Y.F. GOU, C GUO, R.S. QIN; NO.202201BE070001-15). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.