Multisensory causal inference is feature-specific, not object-based

Philos Trans R Soc Lond B Biol Sci. 2023 Sep 25;378(1886):20220345. doi: 10.1098/rstb.2022.0345. Epub 2023 Aug 7.

Abstract

Multisensory integration depends on causal inference about the sensory signals. We tested whether implicit causal-inference judgements pertain to entire objects or focus on task-relevant object features. Participants in our study judged virtual visual, haptic and visual-haptic surfaces with respect to two features-slant and roughness-against an internal standard in a two-alternative forced-choice task. Modelling of participants' responses revealed that the degree to which their perceptual judgements were based on integrated visual-haptic information varied unsystematically across features. For example, a perceived mismatch between visual and haptic roughness would not deter the observer from integrating visual and haptic slant. These results indicate that participants based their perceptual judgements on a feature-specific selection of information, suggesting that multisensory causal inference proceeds not at the object level but at the level of single object features. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Keywords: causal inference; cue integration; roughness; slant; visual–haptic.

Publication types

  • Research Support, Non-U.S. Gov't
  • Research Support, N.I.H., Extramural

MeSH terms

  • Humans
  • Judgment
  • Touch Perception* / physiology
  • Visual Perception / physiology

Associated data

  • figshare/10.6084/m9.figshare.c.6729986