Preschoolers' crossmodal mappings of timbre

Atten Percept Psychophys. 2020 Jul;82(5):2230-2236. doi: 10.3758/s13414-020-02015-0.

Abstract

Crossmodal correspondences have been of interest to researchers for nearly a century, although it is only more recently that interactions related to timbre have been examined systematically. Timbre is often described using crossmodal adjectives (e.g., bright, smooth). However, it is not clear whether these semantic conventions are primarily the result of low-level multisensory interactions or are more a product of associative learning and musical training. Do young children exhibit crossmodal correspondences involving timbre? The aim of this study was to investigate the effects of timbre, age, and sensory modality (visual and tactile) on the consistency and congruency of young children's patterns of crossmodal mappings. Preschool children (N = 69, M age = 4.51) completed a novel audio-visual and audio-tactile association task. Results indicate that children are moderately consistent in their associations; mappings are largely congruent with adult associations; and results suggest a possible developmental time course for the establishment of crossmodal correspondences between approximately ages 3 and 6. However, congruency is dependent on modality, with robust agreement in the tactile-auditory domain but a good deal more variance and a stronger developmental influence on visual-auditory associations. These results are the first to demonstrate that crossmodal correspondences are a feature of timbre perception early in development.

Keywords: Brightness perception; Crossmodal correspondences; Development; Preschool children; Tactile perception; Timbre.

MeSH terms

  • Adult
  • Child
  • Child, Preschool
  • Conditioning, Classical
  • Humans
  • Language
  • Semantics
  • Touch*
  • Visual Perception*