Facial Weakness Analysis and Quantification of Static Images

IEEE J Biomed Health Inform. 2020 Aug;24(8):2260-2267. doi: 10.1109/JBHI.2020.2964520. Epub 2020 Jan 7.

Abstract

Facial weakness is a symptom commonly associated to lack of facial muscle control due to neurological injury. Several diseases are associated with facial weakness such as stroke and Bell's palsy. The use of digital imaging through mobile phones, tablets, personal computers and other devices could provide timely opportunity for detection, which if accurate enough can improve treatment by enabling faster patient triage and recovery progress monitoring. Most of the existing facial weakness detection approaches from static images are based on facial landmarks from which geometric features can be calculated. Landmark-based methods, however, can suffer from inaccuracies in face landmarks localization. In this study, We also experimentally evaluate the performance of several feature extraction methods for measuring facial weakness, including the landmark-based features, as well as intensity-based features on a neurologist-certified dataset that comprises 186 images of normal, 125 images of left facial weakness, and 126 images of right facial weakness. We demonstrate that, for the application of facial weakness detection from single (static) images, approaches that incorporate the Histogram of Oriented Gradients (HoG) features tend to be more accurate.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Anatomic Landmarks / diagnostic imaging
  • Deep Learning
  • Face / diagnostic imaging
  • Facial Muscles / diagnostic imaging*
  • Facial Paralysis / diagnostic imaging*
  • Humans
  • Image Interpretation, Computer-Assisted / methods*
  • Muscle Weakness / diagnostic imaging*