Data-driven load frequency cooperative control for multi-area power system integrated with VSCs and EV aggregators under cyber-attacks

Guangdou Zhang; Jian Li; Yankai Xing; Olusola Bamisile; Qi Huang

doi:10.1016/j.isatra.2023.09.018

Data-driven load frequency cooperative control for multi-area power system integrated with VSCs and EV aggregators under cyber-attacks

ISA Trans. 2023 Dec:143:440-457. doi: 10.1016/j.isatra.2023.09.018. Epub 2023 Oct 3.

Authors

Guangdou Zhang¹, Jian Li², Yankai Xing³, Olusola Bamisile⁴, Qi Huang⁵

Affiliations

¹ Power System Wide-area Measurement and Control Key Laboratory of Sichuan Province, School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China. Electronic address: gdcheung@std.uestc.edu.cn.
² Power System Wide-area Measurement and Control Key Laboratory of Sichuan Province, School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China. Electronic address: leejian@uestc.edu.cn.
³ Power System Wide-area Measurement and Control Key Laboratory of Sichuan Province, School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China. Electronic address: xingyankai@uestc.edu.cn.
⁴ Power System Wide-area Measurement and Control Key Laboratory of Sichuan Province, School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Sichuan Industrial Internet Intelligent Monitoring and Application Engineering Technology Research Center, Chengdu University of Technology, Chenghua District, Chengdu, Sichuan, China. Electronic address: Boomfem@cdut.edu.cn.
⁵ Power System Wide-area Measurement and Control Key Laboratory of Sichuan Province, School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China; Electrical Engineering Department, Southwest University of Science and Technology, Mianyang, Sichuan, China. Electronic address: hwong@uestc.edu.cn.

PMID: 37867022
DOI: 10.1016/j.isatra.2023.09.018

Abstract

This paper proposes a cooperative load frequency control (LFC) strategy based on a multi-agent deep reinforcement learning (MADRL) framework for the multi-area power system in the presence of voltage source converters (VSCs) and electric vehicle (EV) aggregators under cyber-attacks. Different from the existing LFC model, a novel transfer function of VSCs is first improved by the space-vector technique and integrated with EV aggregators to develop a multi-area training environment. By installing the agent in different control areas and interacting state transition information between agents and the new environment, the MADRL-based control strategy is achieved for centralized training and decentralized execution. Thus, the proposed MADRL method can coordinate thermal turbines, VSCs, as well as EV aggregators in the different control areas. Furthermore, a suitable cyber-attack model that can circumvent bad data detection (BDD) is reconstructed according to the perspective of adversaries for the LFC system. Then the double critic networks and parameter updating policy are designed to eliminate and mitigate the fluctuations caused by cyber-attacks. The comparative simulation with other control strategies on a three-area test power system demonstrates the superior performance of the proposed MADRL-based approach.

Keywords: Cyber-attacks; Electric vehicle aggregators; Load frequency cooperative control; Multi-agent deep reinforcement learning; Voltage source converter.