Intermodulation from Unisensory to Multisensory Perception: A Review

Brain Sci. 2022 Nov 25;12(12):1617. doi: 10.3390/brainsci12121617.

Abstract

Previous intermodulation (IM) studies have employed two (or more) temporal modulations of a stimulus, with different local elements of the stimulus being modulated by different frequencies. Brain activities of IM obtained mainly from electroencephalograms (EEG) have been analyzed in the frequency domain. As a powerful tool, IM, which can provide a direct and objective physiological measure of neural interaction, has emerged as a promising method to decipher neural interactions in visual perception, and reveal the underlying different perceptual processing levels. In this review, we summarize the recent applications of IM in visual perception, detail the protocols and types of IM, and extend its utility and potential applications to the multisensory domain. We propose that using IM could prevail in partially revealing the potential hierarchical processing of multisensory information and contribute to a deeper understanding of the underlying brain dynamics.

Keywords: MVPA; computational model; electroencephalogram (EEG); frequency-tagging; intermodulation components (IMs); multisensory; neural interactions; neural network.

Publication types

  • Review