Emotion Recognition Using a Reduced Set of EEG Channels Based on Holographic Feature Maps

Sensors (Basel). 2022 Apr 23;22(9):3248. doi: 10.3390/s22093248.

Abstract

An important function of the construction of the Brain-Computer Interface (BCI) device is the development of a model that is able to recognize emotions from electroencephalogram (EEG) signals. Research in this area is very challenging because the EEG signal is non-stationary, non-linear, and contains a lot of noise due to artifacts caused by muscle activity and poor electrode contact. EEG signals are recorded with non-invasive wearable devices using a large number of electrodes, which increase the dimensionality and, thereby, also the computational complexity of EEG data. It also reduces the level of comfort of the subjects. This paper implements our holographic features, investigates electrode selection, and uses the most relevant channels to maximize model accuracy. The ReliefF and Neighborhood Component Analysis (NCA) methods were used to select the optimal electrodes. Verification was performed on four publicly available datasets. Our holographic feature maps were constructed using computer-generated holography (CGH) based on the values of signal characteristics displayed in space. The resulting 2D maps are the input to the Convolutional Neural Network (CNN), which serves as a feature extraction method. This methodology uses a reduced set of electrodes, which are different between men and women, and obtains state-of-the-art results in a three-dimensional emotional space. The experimental results show that the channel selection methods improve emotion recognition rates significantly with an accuracy of 90.76% for valence, 92.92% for arousal, and 92.97% for dominance.

Keywords: Brain-Computer Interface; Neighborhood Component Analysis; ReliefF; computer-generated holography; deep learning; electroencephalogram; gender specific emotion recognition; valence-arousal-dominance model.

MeSH terms

  • Arousal
  • Brain-Computer Interfaces*
  • Electroencephalography / methods
  • Emotions / physiology
  • Female
  • Holography*
  • Humans
  • Male