Crossmodal enhancement of visual orientation discrimination by looming sounds requires functional activation of primary visual areas: a case study

Abstract

Approaching or looming sounds are salient, potentially threatening stimuli with particular impact on visual processing. The early crossmodal effects by looming sounds (Romei, Murray, Cappe, & Thut, 2009) and their selective impact on visual orientation discrimination (Leo, Romei, Freeman, Ladavas, & Driver, 2011) suggest that these multisensory interactions may take place already within low-level visual cortices. To investigate this hypothesis, we tested a patient (SDV) with bilateral occipital lesion and spared residual portions of V1/V2. Accordingly, SDV׳s visual perimetry revealed blindness of the central visual field with some residual peripheral vision. In two experiments we tested for the influence of looming vs. receding and stationary sounds on SDV׳s line orientation discrimination (orientation discrimination experiment) and visual detection abilities (detection experiment) in the preserved or blind portions of the visual field, corresponding to spared and lesioned areas of V1, respectively. In the visual orientation discrimination experiment we found that SDV visual orientation sensitivity significantly improved for visual targets paired with looming sounds but only for lines presented in the partially preserved visual field. In the visual detection experiment, where SDV was required to simply detect the same stimuli presented in the orientation discrimination experiment, a generalised sound-induced visual improvement both in the intact and in blind portion of the visual field was observed. These results provide direct evidence that early visual areas are critically involved in crossmodal modulation of visual orientation sensitivity by looming sounds. Thus, a lesion in V1 prevents the enhancement of visual orientation sensitivity. In contrast, the same lesion does not prevent the visual detection enhancement by a sound, probably due to alternative visual pathways (e.g. retino-colliculo-extrastriate) which are usually spared in these patients and able to mediate the crossmodal enhancement of basic visual abilities such as detection.

Keywords: Cortical blindness; Looming sounds; Multisensory integration; Visual detection; Visual orientation discrimination.