Fusion of Low-Level Descriptors of Digital Voice Recordings for Dementia Assessment

J Alzheimers Dis. 2023;96(2):507-514. doi: 10.3233/JAD-230560.

Abstract

Digital voice recordings can offer affordable, accessible ways to evaluate behavior and function. We assessed how combining different low-level voice descriptors can evaluate cognitive status. Using voice recordings from neuropsychological exams at the Framingham Heart Study, we developed a machine learning framework fusing spectral, prosodic, and sound quality measures early in the training cycle. The model's area under the receiver operating characteristic curve was 0.832 (±0.034) in differentiating persons with dementia from those who had normal cognition. This offers a data-driven framework for analyzing minimally processed voice recordings for cognitive assessment, highlighting the value of digital technologies in disease detection and intervention.

Keywords: Alzheimer’s disease; dementia; digital health; machine learning; neuropsychological testing; voice recording.

Publication types

  • Letter
  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Alzheimer Disease* / diagnosis
  • Cognition
  • Cognitive Dysfunction* / psychology
  • Dementia* / diagnosis
  • Dementia* / psychology
  • Humans
  • ROC Curve
  • Voice*