Defining Auditory-Visual Objects: Behavioral Tests and Physiological Mechanisms

Trends Neurosci. 2016 Feb;39(2):74-85. doi: 10.1016/j.tins.2015.12.007. Epub 2016 Jan 15.

Abstract

Crossmodal integration is a term applicable to many phenomena in which one sensory modality influences task performance or perception in another sensory modality. We distinguish the term binding as one that should be reserved specifically for the process that underpins perceptual object formation. To unambiguously differentiate binding form other types of integration, behavioral and neural studies must investigate perception of a feature orthogonal to the features that link the auditory and visual stimuli. We argue that supporting true perceptual binding (as opposed to other processes such as decision-making) is one role for cross-sensory influences in early sensory cortex. These early multisensory interactions may therefore form a physiological substrate for the bottom-up grouping of auditory and visual stimuli into auditory-visual (AV) objects.

Keywords: auditory cortex; binding; crossmodal; multisensory; neurophysiology; psychophysics.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't
  • Review

MeSH terms

  • Acoustic Stimulation / methods
  • Animals
  • Auditory Cortex / physiology*
  • Auditory Pathways / physiology
  • Auditory Perception / physiology*
  • Behavior Rating Scale*
  • Brain Mapping / methods
  • Humans
  • Photic Stimulation / methods
  • Visual Cortex / physiology*
  • Visual Pathways / physiology
  • Visual Perception / physiology*