EEG-based analysis for pilots' at-risk cognitive competency identification using RF-CNN algorithm

Shaoqi Jiang; Weijiong Chen; Zhenzhen Ren; He Zhu

doi:10.3389/fnins.2023.1172103

EEG-based analysis for pilots' at-risk cognitive competency identification using RF-CNN algorithm

Front Neurosci. 2023 Apr 21:17:1172103. doi: 10.3389/fnins.2023.1172103. eCollection 2023.

Authors

Shaoqi Jiang^{1

2}, Weijiong Chen^{2

3}, Zhenzhen Ren³, He Zhu¹

Affiliations

¹ College of Information Engineering, Jinhua Polytechnic, Jinhua, Zhejiang, China.
² College of Environment and Engineering, Shanghai Maritime University, Shanghai, China.
³ College of Merchant Marine, Shanghai Maritime University, Shanghai, China.

Abstract

Cognitive competency is an essential complement to the existing ship pilot screening system that should be focused on. Situation awareness (SA), as the cognitive foundation of unsafe behaviors, is susceptible to influencing piloting performance. To address this issue, this paper develops an identification model based on random forest- convolutional neural network (RF-CNN) method for detecting at-risk cognitive competency (i.e., low SA level) using wearable EEG signal acquisition technology. In the poor visibility scene, the pilots' SA levels were correlated with EEG frequency metrics in frontal (F) and central (C) regions, including α/β (p = 0.071 < 0.1 in F and p = 0.042 < 0.05 in C), θ/(α + θ) (p = 0.048 < 0.05 in F and p = 0.026 < 0.05 in C) and (α + θ)/β (p = 0.046 < 0.05 in F and p = 0.012 < 0.05 in C), and then a total of 12 correlation features were obtained based on a 5 s sliding time window. Using the RF algorithm developed by principal component analysis (PCA) for further feature combination, these salient combinations are used as input sets to obtain the CNN algorithm with optimal parameters for identification. The comparative results of the proposed RF-CNN (accuracy is 84.8%) against individual RF (accuracy is 78.1%) and CNN (accuracy is 81.6%) methods demonstrate that the RF-CNN with feature optimization provides the best identification of at-risk cognitive competency (accuracy increases 6.7%). Overall, the results of this paper provide key technical support for the development of an adaptive evaluation system of pilots' cognitive competency based on intelligent technology, and lay the foundation and framework for monitoring the cognitive process and competency of ship piloting operation in China.

Keywords: cognitive competency; correlation evaluation; feature identification; ship pilotage; situation awareness.