Noncontact measurement of emotional and physiological changes in heart rate from a webcam

Psychophysiology. 2018 Apr;55(4). doi: 10.1111/psyp.13005. Epub 2017 Sep 21.

Abstract

Heart rate, measured in beats per minute, can be used as an index of an individual's physiological state. Each time the heart beats, blood is expelled and travels through the body. This blood flow can be detected in the face using a standard webcam that is able to pick up subtle changes in color that cannot be seen by the naked eye. Due to the light absorption spectrum of blood, we are able to detect differences in the amount of light absorbed by the blood traveling just below the skin (i.e., photoplethysmography). By modulating emotional and physiological stress-that is, viewing arousing images and sitting versus standing, respectively-to elicit changes in heart rate, we explored the feasibility of using a webcam as a psychophysiological measurement of autonomic activity. We found a high level of agreement between established physiological measures, electrocardiogram, and blood pulse oximetry, and heart rate estimates obtained from the webcam. We thus suggest webcams can be used as a noninvasive and readily available method for measuring psychophysiological changes, easily integrated into existing stimulus presentation software and hardware setups.

Keywords: arousal; autonomic activity; emotion; heart rate; webcam.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adolescent
  • Adult
  • Algorithms
  • Autonomic Nervous System / physiology*
  • Emotions / physiology*
  • Female
  • Heart Rate / physiology*
  • Humans
  • Image Processing, Computer-Assisted
  • Male
  • Oximetry
  • Photoplethysmography
  • Software
  • Young Adult