Machine Learning-Based Automatic Rating for Cardinal Symptoms of Parkinson Disease

Neurology. 2021 Mar 30;96(13):e1761-e1769. doi: 10.1212/WNL.0000000000011654. Epub 2021 Feb 10.

Abstract

Objective: We developed and investigated the feasibility of a machine learning-based automated rating for the 2 cardinal symptoms of Parkinson disease (PD): resting tremor and bradykinesia.

Methods: Using OpenPose, a deep learning-based human pose estimation program, we analyzed video clips for resting tremor and finger tapping of the bilateral upper limbs of 55 patients with PD (110 arms). Key motion parameters, including resting tremor amplitude and finger tapping speed, amplitude, and fatigue, were extracted to develop a machine learning-based automatic Unified Parkinson's Disease Rating Scale (UPDRS) rating using support vector machine (SVM) method. To evaluate the performance of this model, we calculated weighted κ and intraclass correlation coefficients (ICCs) between the model and the gold standard rating by a movement disorder specialist who is trained and certified by the Movement Disorder Society for UPDRS rating. These values were compared to weighted κ and ICC between a nontrained human rater and the gold standard rating.

Results: For resting tremors, the SVM model showed a very good to excellent reliability range with the gold standard rating (κ 0.791; ICC 0.927), with both values higher than that of nontrained human rater (κ 0.662; ICC 0.861). For finger tapping, the SVM model showed a very good reliability range with the gold standard rating (κ 0.700 and ICC 0.793), which was comparable to that for nontrained human raters (κ 0.627; ICC 0.797).

Conclusion: Machine learning-based algorithms that automatically rate PD cardinal symptoms are feasible, with more accurate results than nontrained human ratings.

Classification of evidence: This study provides Class II evidence that machine learning-based automated rating of resting tremor and bradykinesia in people with PD has very good reliability compared to a rating by a movement disorder specialist.

Publication types

  • Research Support, Non-U.S. Gov't
  • Video-Audio Media

MeSH terms

  • Aged
  • Automation
  • Deep Learning*
  • Diagnosis, Computer-Assisted
  • Female
  • Humans
  • Hypokinesia / diagnosis
  • Hypokinesia / physiopathology*
  • Machine Learning
  • Male
  • Middle Aged
  • Parkinson Disease / diagnosis
  • Parkinson Disease / physiopathology*
  • Severity of Illness Index
  • Support Vector Machine
  • Tremor / diagnosis
  • Tremor / physiopathology*
  • Video Recording*