Action force modulates action binding: evidence for a multisensory information integration explanation

Exp Brain Res. 2020 Sep;238(9):2019-2029. doi: 10.1007/s00221-020-05861-4. Epub 2020 Jul 2.

Abstract

Action binding refers to the observation that the perceived time of an action (e.g., a keypress) is shifted towards the distal sensory feedback (usually a sound) triggered by that action. Surprisingly, the role of somatosensory feedback for this phenomenon has been largely ignored. We fill this gap by showing that the somatosensory feedback, indexed by keypress peak force, is functional in judging keypress time. Specifically, the strength of somatosensory feedback is positively correlated with reported keypress time when the keypress is not associated with an auditory feedback and negatively correlated when the keypress triggers an auditory feedback. The result is consistent with the view that the reported keypress time is shaped by sensory information from different modalities. Moreover, individual differences in action binding can be explained by a sensory information weighting between somatosensory and auditory feedback. At the group level, increasing the strength of somatosensory feedback can decrease action binding to a level not being detected statistically. Therefore, a multisensory information integration account (between somatosensory and auditory inputs) explains action binding at both a group level and an individual level.

Keywords: Action binding; Force; Multisensory processing; Somatosensory feedback.

MeSH terms

  • Acoustic Stimulation
  • Feedback, Sensory*
  • Humans
  • Individuality*