Mapping the dynamics of visual feature coding: Insights into perception and integration

PLoS Comput Biol. 2024 Jan 8;20(1):e1011760. doi: 10.1371/journal.pcbi.1011760. eCollection 2024 Jan.

Abstract

The basic computations performed in the human early visual cortex are the foundation for visual perception. While we know a lot about these computations, a key missing piece is how the coding of visual features relates to our perception of the environment. To investigate visual feature coding, interactions, and their relationship to human perception, we investigated neural responses and perceptual similarity judgements to a large set of visual stimuli that varied parametrically along four feature dimensions. We measured neural responses using electroencephalography (N = 16) to 256 grating stimuli that varied in orientation, spatial frequency, contrast, and colour. We then mapped the response profiles of the neural coding of each visual feature and their interactions, and related these to independently obtained behavioural judgements of stimulus similarity. The results confirmed fundamental principles of feature coding in the visual system, such that all four features were processed simultaneously but differed in their dynamics, and there was distinctive conjunction coding for different combinations of features in the neural responses. Importantly, modelling of the behaviour revealed that every stimulus feature contributed to perceptual judgements, despite the untargeted nature of the behavioural task. Further, the relationship between neural coding and behaviour was evident from initial processing stages, signifying that the fundamental features, not just their interactions, contribute to perception. This study highlights the importance of understanding how feature coding progresses through the visual hierarchy and the relationship between different stages of processing and perception.

MeSH terms

  • Brain Mapping
  • Electroencephalography
  • Humans
  • Photic Stimulation / methods
  • Visual Cortex* / physiology
  • Visual Perception* / physiology

Grants and funding

This work was supported by an Australian Research Council (ARC) Discovery Early Career Researcher Awards awarded to TG (DE230100380) and AKR (DE200101159), and ARC Discovery Projects awarded to TAC (DP200101787). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.