Interwoven fluctuations during intermodal perception: fractality in head sway supports the use of visual feedback in haptic perceptual judgments by manual wielding

Abstract

Intermodal integration required for perceptual learning tasks is rife with individual differences. Participants vary in how they use perceptual information to one modality. One participant alone might change her own response over time. Participants vary further in their use of feedback through one modality to inform another modality. Two experiments test the general hypothesis that perceptual-motor fluctuations reveal both information use within modality and coordination among modalities. Experiment 1 focuses on perceptual learning in dynamic touch, in which participants use exploratory hand-wielding of unseen objects to make visually guided length judgments and use visual feedback to rescale their judgments of the same mechanical information. Previous research found that the degree of fractal temporal scaling (i.e., "fractality") in hand-wielding moderates the use of mechanical information. Experiment 1 shows that head-sway fractality moderates the use of visual information. Further, experience with feedback increases head-sway fractality and prolongs its effect on later hand-wielding fractality. Experiment 2 replicates effects of head-sway fractality moderating use of visual information in a purely visual-judgment task. Together, these findings suggest that fractal fluctuations may provide a modal-general window onto not just how participants use perceptual information but also how well they may integrate information among different modalities.