Sensorimotor contingency modulates breakthrough of virtual 3D objects during a breaking continuous flash suppression paradigm

Keisuke Suzuki; David J Schwartzman; Rafael Augusto; Anil K Seth

doi:10.1016/j.cognition.2019.03.003

Sensorimotor contingency modulates breakthrough of virtual 3D objects during a breaking continuous flash suppression paradigm

Cognition. 2019 Jun:187:95-107. doi: 10.1016/j.cognition.2019.03.003. Epub 2019 Mar 7.

Authors

Keisuke Suzuki¹, David J Schwartzman², Rafael Augusto³, Anil K Seth²

Affiliations

¹ Department of Informatics, University of Sussex, Brighton BN1 9QJ, United Kingdom; Sackler Centre for Consciousness Science, University of Sussex, Brighton BN1 9QJ, United Kingdom. Electronic address: K.Suzuki@sussex.ac.uk.
² Department of Informatics, University of Sussex, Brighton BN1 9QJ, United Kingdom; Sackler Centre for Consciousness Science, University of Sussex, Brighton BN1 9QJ, United Kingdom.
³ Universidade de Lisboa, Alameda da Universidade, Lisboa 1649-004, Portugal.

PMID: 30852262
DOI: 10.1016/j.cognition.2019.03.003

Abstract

To investigate how embodied sensorimotor interactions shape subjective visual experience, we developed a novel combination of Virtual Reality (VR) and Augmented Reality (AR) within an adapted breaking continuous flash suppression (bCFS) paradigm. In a first experiment, participants manipulated novel virtual 3D objects, viewed through a head-mounted display, using three interlocking cogs. This setup allowed us to manipulate the sensorimotor contingencies governing interactions with virtual objects, while characterising the effects on subjective visual experience by measuring breakthrough times from bCFS. We contrasted the effects of the congruency (veridical versus reversed sensorimotor coupling) and contingency (live versus replayed interactions) using a motion discrimination task. The results showed that the contingency but not congruency of sensorimotor coupling affected breakthrough times, with live interactions displaying faster breakthrough times. In a second experiment, we investigated how the contingency of sensorimotor interactions affected object category discrimination within a more naturalistic setting, using a motion tracker that allowed object interactions with increased degrees of freedom. We again found that breakthrough times were faster for live compared to replayed interactions (contingency effect). Together, these data demonstrate that bCFS breakthrough times for unfamiliar 3D virtual objects are modulated by the contingency of the dynamic causal coupling between actions and their visual consequences, in line with theories of perception that emphasise the influence of sensorimotor contingencies on visual experience. The combination of VR/AR and motion tracking technologies with bCFS provides a novel methodology extending the use of binocular suppression paradigms into more dynamic and realistic sensorimotor environments.

Keywords: Affordance; Augmented reality; Continuous flash suppression; Sensorimotor coupling; Virtual reality; Visual awareness.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Adult
Awareness / physiology*
Depth Perception / physiology*
Female
Humans
Male
Pattern Recognition, Visual / physiology*
Psychomotor Performance / physiology*
User-Computer Interface
Virtual Reality
Vision, Binocular / physiology*
Young Adult