Efficacy of novel attention-based gated recurrent units transformer for depression detection using electroencephalogram signals

Health Inf Sci Syst. 2022 Dec 29;11(1):1. doi: 10.1007/s13755-022-00205-8. eCollection 2023 Dec.

Abstract

Purpose: Depression is a global challenge causing psychological and intellectual problems that require efficient diagnosis. Electroencephalogram (EEG) signals represent the functional state of the human brain and can help build an accurate and viable technique for the early prediction and treatment of depression.

Methods: An attention-based gated recurrent units transformer (AttGRUT) time-series model is proposed to efficiently identify EEG perturbations in depressive patients. Statistical, spectral and wavelet features were first extracted from the 60-channel EEG signal data. Then, two feature selection techniques, recursive feature elimination and the Boruta algorithm, both with Shapley additive explanations, were utilised for selecting essential features.

Results: The proposed model outperformed the two baseline and two hybrid time-series models-long short-term memory (LSTM), gated recurrent units (GRU), convolutional neural network-LSTM (CNN-LSTM), and CNN-GRU-achieving an accuracy of up to 98.67%. Feature selection considerably increased the performance across all time-series models.

Conclusion: Based on the obtained results, novel feature selection greatly affected the results of the baseline and hybrid time-series models. The proposed AttGRUT can be implemented and tested in other domains by using different modalities for prediction.

Supplementary information: The online version contains supplementary material available at 10.1007/s13755-022-00205-8.

Keywords: Deep learning; Depression; Electroencephalogram; Multi head attention; Transformer.