Visual perception of highly memorable images is mediated by a distributed network of ventral visual regions that enable a late memorability response

PLoS Biol. 2024 Apr 1;22(4):e3002564. doi: 10.1371/journal.pbio.3002564. eCollection 2024 Apr.

Abstract

Behavioral and neuroscience studies in humans and primates have shown that memorability is an intrinsic property of an image that predicts its strength of encoding into and retrieval from memory. While previous work has independently probed when or where this memorability effect may occur in the human brain, a description of its spatiotemporal dynamics is missing. Here, we used representational similarity analysis (RSA) to combine functional magnetic resonance imaging (fMRI) with source-estimated magnetoencephalography (MEG) to simultaneously measure when and where the human cortex is sensitive to differences in image memorability. Results reveal that visual perception of High Memorable images, compared to Low Memorable images, recruits a set of regions of interest (ROIs) distributed throughout the ventral visual cortex: a late memorability response (from around 300 ms) in early visual cortex (EVC), inferior temporal cortex, lateral occipital cortex, fusiform gyrus, and banks of the superior temporal sulcus. Image memorability magnitude results are represented after high-level feature processing in visual regions and reflected in classical memory regions in the medial temporal lobe (MTL). Our results present, to our knowledge, the first unified spatiotemporal account of visual memorability effect across the human cortex, further supporting the levels-of-processing theory of perception and memory.

MeSH terms

  • Animals
  • Brain Mapping / methods
  • Brain* / physiology
  • Cerebral Cortex / physiology
  • Humans
  • Magnetic Resonance Imaging / methods
  • Magnetoencephalography / methods
  • Temporal Lobe / diagnostic imaging
  • Temporal Lobe / physiology
  • Visual Perception* / physiology

Grants and funding

This work was funded by the Vannevar Bush Faculty Fellowship program funded by the Office of Naval Research grant No. N00014-16-1-3116 (to A.O.; https://basicresearch.defense.gov/); National Science Foundation award 1532591 in Neural and Cognitive Systems (to A.O.; https://www.nsf.gov/); Multidisciplinary University Research Initiative (MURI) award by the Army Research Office grant No. W911NF-23-1-0277 (to A.O.: https://arl.devcom.army.mil/who-we-are/aro/); the EECS MathWorks Fellowship (to B.L.; https://www.mathworks.com/). No funders had any role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.