The Effects of Word Priming on Emotion Classification from Neurological Signals

Annu Int Conf IEEE Eng Med Biol Soc. 2022 Jul:2022:410-413. doi: 10.1109/EMBC48229.2022.9871624.

Abstract

Affective states play an important role in human behavior and decision-making. In recent years, several affective brain-computer interface (aBCI) studies have focused on developing an emotion classifier based on elicited emotions within the user. However, it is difficult to achieve consistency in elicited emotions across populations, which can lead to dataset imbalances. The experimental design presented in this paper seeks to avoid consistency issues by asking the participant to classify the emotion portrayed in images of facial expressions, rather than their own emotions. Priming is also a common technique used in psychology studies that is known to influence emotional perception. To improve participant accuracy, we investigated matching and mis-matched word priming for the facial expression images. Electro-encephalogram (EEG) data were used to generate images fed into a classifier based on the Big Transfer model, BiT-M R101x1. The primed images resulted in higher classification accuracy overall. Further, by building different classifier models for both mis-matched primed images and matching primed images, we were able to achieve classification accuracies above 90%. We also provided the classifier with the true labels of the photographs instead of the labels generated by the participants and achieved similar results. The experimental paradigm of measuring brain activity during the emotional classification of another individual provides consistently high, balanced classification accuracies.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Brain-Computer Interfaces*
  • Emotions*
  • Humans
  • Motor Activity
  • Research Design