Differentiating Use of Facial Expression between Individuals with and without Traumatic Brain Injury Using Affectiva Software: A Pilot Study

Int J Environ Res Public Health. 2023 Jan 9;20(2):1169. doi: 10.3390/ijerph20021169.

Abstract

This study investigated the feasibility of using an automated facial coding engine, Affectiva (integrated in iMotions, version 8.2), for evaluating facial expression after traumatic brain injury (TBI). An observational cross-sectional study was conducted based on facial expression data from videos of participants with TBI and control participants. The aims were to compare TBI and control groups, and identify confounding factors affecting the data analysis. Video samples of two narrative tasks (personal event and story retell) from ten participants with severe TBI and ten control participants without TBI were analyzed using Affectiva. Automated data on participants' engagement, smile and brow furrow were compared statistically between and within groups. Qualitative notes for each sample were also recorded. Affectiva detected a higher percentage of time of engagement for TBI participants than for control participants on both tasks. There was also a higher percentage of time of smiling for TBI participants in one task. Within groups, there were no significant differences between the two narrative tasks. Affectiva provides standardized data about facial expression and may be sensitive to detecting change in the use of facial expression after TBI. This study also identified factors to avoid during videorecording to ensure high quality samples for future research.

Keywords: assessment tool; facial expression; social communication; software; traumatic brain injury.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Brain Injuries, Traumatic*
  • Cross-Sectional Studies
  • Facial Expression*
  • Humans
  • Pilot Projects
  • Smiling

Grants and funding

This research received no external funding. Author R.R. was supported by funding through icare NSW.