Disturbance-Aware Neuro-Optimal System Control Using Generative Adversarial Control Networks

IEEE Trans Neural Netw Learn Syst. 2021 Oct;32(10):4565-4576. doi: 10.1109/TNNLS.2020.3022950. Epub 2021 Oct 5.

Abstract

Disturbance, which is generally unknown to the controller, is unavoidable in real-world systems and it may affect the expected system state and output. Existing control methods, like robust model predictive control, can produce robust solutions to maintain the system stability. However, these robust methods trade the solution optimality for stability. In this article, a method called generative adversarial control networks (GACNs) is proposed to train a controller via demonstrations of the optimal controller. By formulating the optimal control problem in the presence of disturbance, the controller trained by GACNs obtains neuro-optimal solutions without knowing the future disturbance and determines the objective function explicitly. A joint loss, composed of the adversarial loss and the least square loss, is designed to be used in the training of the generator. Experimental results on simulated systems with disturbance show that GACNs outperform other compared control methods.