Research on Emotion Recognition Method Based on Adaptive Window and Fine-Grained Features in MOOC Learning

Sensors (Basel). 2022 Sep 27;22(19):7321. doi: 10.3390/s22197321.

Abstract

In MOOC learning, learners' emotions have an important impact on the learning effect. In order to solve the problem that learners' emotions are not obvious in the learning process, we propose a method to identify learner emotion by combining eye movement features and scene features. This method uses an adaptive window to partition samples and enhances sample features through fine-grained feature extraction. Using an adaptive window to partition samples can make the eye movement information in the sample more abundant, and fine-grained feature extraction from an adaptive window can increase discrimination between samples. After adopting the method proposed in this paper, the four-category emotion recognition accuracy of the single modality of eye movement reached 65.1% in MOOC learning scenarios. Both the adaptive window partition method and the fine-grained feature extraction method based on eye movement signals proposed in this paper can be applied to other modalities.

Keywords: adaptive window; audio and visual features; emotion recognition; eye movement signal; fine-grained feature.

MeSH terms

  • Education, Distance*
  • Emotions
  • Eye Movements
  • Learning