Deep Reinforcement Learning for the Detection of Abnormal Data in Smart Meters

Sensors (Basel). 2022 Nov 6;22(21):8543. doi: 10.3390/s22218543.

Abstract

The rapidly growing power data in smart grids have created difficulties in security management. The processing of large-scale power data with the use of artificial intelligence methods has become a hotspot research topic. Considering the early warning detection problem of smart meters, this paper proposes an abnormal data detection network based on Deep Reinforcement Learning, which includes a main network and a target network composed of deep learning networks. This work uses the greedy policy algorithm to find the action of the maximum value of Q based on the Q-learning method to obtain the optimal calculation policy. It also uses the reward value and discount factor to optimize the target value. In particular, this study uses the fuzzy c-means method to predict the future state information value, which improves the computational accuracy of the Deep Reinforcement Learning model. The experimental results show that compared with the traditional smart meter data anomaly detection method, the proposed model improves the accuracy of meter data anomaly detection.

Keywords: Q-learning; deep reinforcement learning; smart meters.

MeSH terms

  • Algorithms
  • Artificial Intelligence*
  • Reinforcement, Psychology*
  • Reward