Automatic Detection of Cognitive Impairment with Virtual Reality

Sensors (Basel). 2023 Jan 16;23(2):1026. doi: 10.3390/s23021026.

Abstract

Cognitive impairment features in neuropsychiatric conditions and when undiagnosed can have a severe impact on the affected individual's safety and ability to perform daily tasks. Virtual Reality (VR) systems are increasingly being explored for the recognition, diagnosis and treatment of cognitive impairment. In this paper, we describe novel VR-derived measures of cognitive performance and show their correspondence with clinically-validated cognitive performance measures. We use an immersive VR environment called VStore where participants complete a simulated supermarket shopping task. People with psychosis (k=26) and non-patient controls (k=128) participated in the study, spanning ages 20-79 years. The individuals were split into two cohorts, a homogeneous non-patient cohort (k=99 non-patient participants) and a heterogeneous cohort (k=26 patients, k=29 non-patient participants). Participants' spatio-temporal behaviour in VStore is used to extract four features, namely, route optimality score, proportional distance score, execution error score, and hesitation score using the Traveling Salesman Problem and explore-exploit decision mathematics. These extracted features are mapped to seven validated cognitive performance scores, via linear regression models. The most statistically important feature is found to be the hesitation score. When combined with the remaining extracted features, the multiple linear regression model resulted in statistically significant results with R2 = 0.369, F-Stat = 7.158, p(F-Stat) = 0.000128.

Keywords: cognitive assessment; feature engineering; linear regression; psychosis; statistical learning; virtual reality.

MeSH terms

  • Adult
  • Aged
  • Biometry
  • Cognitive Dysfunction* / diagnosis
  • Humans
  • Middle Aged
  • Recognition, Psychology
  • User-Computer Interface
  • Virtual Reality*
  • Young Adult

Grants and funding

This paper represents independent research part funded by the UK Medical Research Council (MR/N013700/1) and King’s College London MRC Doctoral Training Partnership in Biomedical Sciences, and part funded by the National Institute for Health Research (NIHR) Maudsley Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London. Fundings were awarded to LAP. The views expressed are those of the authors and not necessarily those of the National Health Service, the NIHR or the Department of Health and Social Care.