Infants and Adults Use Visual Cues to Improve Detection and Discrimination of Speech in Noise

J Speech Lang Hear Res. 2019 Oct 25;62(10):3860-3875. doi: 10.1044/2019_JSLHR-H-19-0106. Epub 2019 Oct 16.

Abstract

Purpose This study assessed the extent to which 6- to 8.5-month-old infants and 18- to 30-year-old adults detect and discriminate auditory syllables in noise better in the presence of visual speech than in auditory-only conditions. In addition, we examined whether visual cues to the onset and offset of the auditory signal account for this benefit. Method Sixty infants and 24 adults were randomly assigned to speech detection or discrimination tasks and were tested using a modified observer-based psychoacoustic procedure. Each participant completed 1-3 conditions: auditory-only, with visual speech, and with a visual signal that only cued the onset and offset of the auditory syllable. Results Mixed linear modeling indicated that infants and adults benefited from visual speech on both tasks. Adults relied on the onset-offset cue for detection, but the same cue did not improve their discrimination. The onset-offset cue benefited infants for both detection and discrimination. Whereas the onset-offset cue improved detection similarly for infants and adults, the full visual speech signal benefited infants to a lesser extent than adults on the discrimination task. Conclusions These results suggest that infants' use of visual onset-offset cues is mature, but their ability to use more complex visual speech cues is still developing. Additional research is needed to explore differences in audiovisual enhancement (a) of speech discrimination across speech targets and (b) with increasingly complex tasks and stimuli.

Publication types

  • Randomized Controlled Trial
  • Research Support, N.I.H., Extramural

MeSH terms

  • Acoustic Stimulation
  • Adolescent
  • Adult
  • Cues
  • Female
  • Healthy Volunteers
  • Humans
  • Infant
  • Male
  • Noise
  • Perceptual Masking*
  • Photic Stimulation
  • Psychoacoustics
  • Signal-To-Noise Ratio
  • Speech Perception*
  • Visual Perception*
  • Young Adult