Shape-invariant encoding of dynamic primate facial expressions in human perception

Elife. 2021 Jun 11:10:e61197. doi: 10.7554/eLife.61197.

Abstract

Dynamic facial expressions are crucial for communication in primates. Due to the difficulty to control shape and dynamics of facial expressions across species, it is unknown how species-specific facial expressions are perceptually encoded and interact with the representation of facial shape. While popular neural network models predict a joint encoding of facial shape and dynamics, the neuromuscular control of faces evolved more slowly than facial shape, suggesting a separate encoding. To investigate these alternative hypotheses, we developed photo-realistic human and monkey heads that were animated with motion capture data from monkeys and humans. Exact control of expression dynamics was accomplished by a Bayesian machine-learning technique. Consistent with our hypothesis, we found that human observers learned cross-species expressions very quickly, where face dynamics was represented largely independently of facial shape. This result supports the co-evolution of the visual processing and motor control of facial expressions, while it challenges appearance-based neural network theories of dynamic expression recognition.

Keywords: avatar; cross-species recognition; dynamic faces; emotion expression; human; neuroscience; social communication.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Animals
  • Bayes Theorem
  • Emotions / physiology
  • Face / physiology
  • Facial Expression*
  • Female
  • Humans
  • Macaca mulatta
  • Machine Learning
  • Male
  • Middle Aged
  • Nerve Net / physiology
  • Pattern Recognition, Visual / physiology*
  • Recognition, Psychology / physiology
  • Visual Perception / physiology*
  • Young Adult

Grants and funding

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.