Emotion analysis in children through facial emissivity of infrared thermal imaging

PLoS One. 2019 Mar 20;14(3):e0212928. doi: 10.1371/journal.pone.0212928. eCollection 2019.

Abstract

Physiological signals may be used as objective markers to identify emotions, which play relevant roles in social and daily life. To measure these signals, the use of contact-free techniques, such as Infrared Thermal Imaging (IRTI), is indispensable to individuals who have sensory sensitivity. The goal of this study is to propose an experimental design to analyze five emotions (disgust, fear, happiness, sadness and surprise) from facial thermal images of typically developing (TD) children aged 7-11 years using emissivity variation, as recorded by IRTI. For the emotion analysis, a dataset considered emotional dimensions (valence and arousal), facial bilateral sides and emotion classification accuracy. The results evidence the efficiency of the experimental design with interesting findings, such as the correlation between the valence and the thermal decrement in nose; disgust and happiness as potent triggers of facial emissivity variations; and significant emissivity variations in nose, cheeks and periorbital regions associated with different emotions. Moreover, facial thermal asymmetry was revealed with a distinct thermal tendency in the cheeks, and classification accuracy reached a mean value greater than 85%. From the results, the emissivity variations were an efficient marker to analyze emotions in facial thermal images, and IRTI was confirmed to be an outstanding technique to study emotions. This study contributes a robust dataset to analyze the emotions of 7-11-year-old TD children, an age range for which there is a gap in the literature.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Behavior Observation Techniques / instrumentation
  • Behavior Observation Techniques / methods*
  • Body Temperature / physiology
  • Child
  • Child Behavior / physiology*
  • Datasets as Topic
  • Emotions / physiology
  • Face / diagnostic imaging
  • Face / physiology
  • Feasibility Studies
  • Female
  • Humans
  • Infrared Rays
  • Male
  • Models, Psychological*
  • Reaction Time
  • Thermography / instrumentation
  • Thermography / methods*

Grants and funding

The authors would like to thank Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES/Brazil - http://www.capes.gov.br/), Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq/Brazil - http://lattes.cnpq.br/), and Fundação de Amparo à Pesquisa e Inovação do Espírito Santo (FAPES/Brazil - https://fapes.es.gov.br/) for the financial support. Funder information: FAPES (Funder): 67662536 (Grant Number): Dr. Teodiano Bastos (Grant Recipient). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.