Information-theoretical analysis of the neural code for decoupled face representation

PLoS One. 2024 Jan 26;19(1):e0295054. doi: 10.1371/journal.pone.0295054. eCollection 2024.

Abstract

Processing faces accurately and efficiently is a key capability of humans and other animals that engage in sophisticated social tasks. Recent studies reported a decoupled coding for faces in the primate inferotemporal cortex, with two separate neural populations coding for the geometric position of (texture-free) facial landmarks and for the image texture at fixed landmark positions, respectively. Here, we formally assess the efficiency of this decoupled coding by appealing to the information-theoretic notion of description length, which quantifies the amount of information that is saved when encoding novel facial images, with a given precision. We show that despite decoupled coding describes the facial images in terms of two sets of principal components (of landmark shape and image texture), it is more efficient (i.e., yields more information compression) than the encoding in terms of the image principal components only, which corresponds to the widely used eigenface method. The advantage of decoupled coding over eigenface coding increases with image resolution and is especially prominent when coding variants of training set images that only differ in facial expressions. Moreover, we demonstrate that decoupled coding entails better performance in three different tasks: the representation of facial images, the (daydream) sampling of novel facial images, and the recognition of facial identities and gender. In summary, our study provides a first principle perspective on the efficiency and accuracy of the decoupled coding of facial stimuli reported in the primate inferotemporal cortex.

MeSH terms

  • Animals
  • Cerebral Cortex
  • Facial Expression
  • Facial Recognition*
  • Humans
  • Primates
  • Recognition, Psychology*

Grants and funding

This research received funding from the European Union’s Horizon 2020 Framework Programme for Research and Innovation under the Specific Grant Agreement No. 945539 (Human Brain Project SGA3) and 952215 (TAILOR) to G. P., the MUR PNRR projects PE0000013-FAIR and IR0000011 EBRAINS-Italy to G. P., and the European Research Council under the Grant Agreement No. 820213 (ThinkAhead) to G. P. M. I.-B. has been supported by the grant EU FESR-FSE PON Ricerca e Innovazione 2014-2020 BraVi, awarded to Stefano Panzeri, and by the Spanish Ministry and Agencia Estatal de Investigaci´on (AEI) through Project of I+D+i Ref. PID2020-113681GB-I00, financed by MICIN/AEI/10.13039/501100011033 and FEDER “A way to make Europe. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.