Evaluating fMRI-Based Estimation of Eye Gaze During Naturalistic Viewing

Cereb Cortex. 2020 Mar 14;30(3):1171-1184. doi: 10.1093/cercor/bhz157.

Abstract

The collection of eye gaze information during functional magnetic resonance imaging (fMRI) is important for monitoring variations in attention and task compliance, particularly for naturalistic viewing paradigms (e.g., movies). However, the complexity and setup requirements of current in-scanner eye tracking solutions can preclude many researchers from accessing such information. Predictive eye estimation regression (PEER) is a previously developed support vector regression-based method for retrospectively estimating eye gaze from the fMRI signal in the eye's orbit using a 1.5-min calibration scan. Here, we provide confirmatory validation of the PEER method's ability to infer eye gaze on a TR-by-TR basis during movie viewing, using simultaneously acquired eye tracking data in five individuals (median angular deviation < 2°). Then, we examine variations in the predictive validity of PEER models across individuals in a subset of data (n = 448) from the Child Mind Institute Healthy Brain Network Biobank, identifying head motion as a primary determinant. Finally, we accurately classify which of the two movies is being watched based on the predicted eye gaze patterns (area under the curve = 0.90 ± 0.02) and map the neural correlates of eye movements derived from PEER. PEER is a freely available and easy-to-use tool for determining eye fixations during naturalistic viewing.

Keywords: eye tracking; functional magnetic resonance imaging; naturalistic viewing.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't
  • Validation Study

MeSH terms

  • Adult
  • Brain / physiology*
  • Brain Mapping
  • Eye Movement Measurements*
  • Female
  • Fixation, Ocular / physiology*
  • Humans
  • Image Processing, Computer-Assisted
  • Magnetic Resonance Imaging*
  • Male
  • Middle Aged
  • Photic Stimulation
  • Regression Analysis