A Fault Detection Method Based on an Oil Temperature Forecasting Model Using an Improved Deep Deterministic Policy Gradient Algorithm in the Helicopter Gearbox

Entropy (Basel). 2022 Sep 30;24(10):1394. doi: 10.3390/e24101394.

Abstract

The main gearbox is very important for the operation safety of helicopters, and the oil temperature reflects the health degree of the gearbox; therefore establishing an accurate oil temperature forecasting model is an important step for reliable fault detection. Firstly, in order to achieve accurate gearbox oil temperature forecasting, an improved deep deterministic policy gradient algorithm with a CNN-LSTM basic learner is proposed, which can excavate the complex relationship between oil temperature and working condition. Secondly, a reward incentive function is designed to accelerate the training time costs and to stabilize the model. Further, a variable variance exploration strategy is proposed to enable the agents of the model to fully explore the state space in the early training stage and to gradually converge in the training later stage. Thirdly, a multi-critics network structure is adopted to solve the problem of inaccurate Q-value estimation, which is the key to improving the prediction accuracy of the model. Finally, KDE is introduced to determine the fault threshold to judge whether the residual error is abnormal after EWMA processing. The experimental results show that the proposed model achieves higher prediction accuracy and shorter fault detection time costs.

Keywords: data driven; deep deterministic policy gradient; fault detection; helicopter main gearbox; oil temperature.

Grants and funding

The authors are grateful for the National Key R&D Program of China (Grant Nos. 2018YFB1702401), the financial support from the National Natural Science Foundation of China (Grant Nos. 52275140), the Technology Foundation Strengthening Project Fund (2019-JCJQ-JJ-187) and the ILS Key Laboratory Fund (WDZC20205250308).