Label-less Learning for Emotion Cognition

IEEE Trans Neural Netw Learn Syst. 2020 Jul;31(7):2430-2440. doi: 10.1109/TNNLS.2019.2929071. Epub 2019 Aug 13.

Abstract

In this paper, we propose a label-less learning for emotion cognition (LLEC) to achieve the utilization of a large amount of unlabeled data. We first inspect the unlabeled data from two perspectives, i.e., the feature layer and the decision layer. By utilizing the similarity model and the entropy model, this paper presents a hybrid label-less learning that can automatically label data without human intervention. Then, we design an enhanced hybrid label-less learning to purify the automatic labeled data. To further improve the accuracy of emotion detection model and increase the utilization of unlabeled data, we apply enhanced hybrid label-less learning for multimodal unlabeled emotion data. Finally, we build a real-world test bed to evaluate the LLEC algorithm. The experimental results show that the LLEC algorithm can improve the accuracy of emotion detection significantly.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Automated Facial Recognition / methods*
  • Automated Facial Recognition / trends
  • Cognition* / physiology
  • Deep Learning* / trends
  • Emotions* / physiology
  • Humans
  • Speech Recognition Software* / trends