Performance of seven consumer sleep-tracking devices compared with polysomnography

Evan D Chinoy; Joseph A Cuellar; Kirbie E Huwa; Jason T Jameson; Catherine H Watson; Sara C Bessman; Dale A Hirsch; Adam D Cooper; Sean P A Drummond; Rachel R Markwald

doi:10.1093/sleep/zsaa291

Performance of seven consumer sleep-tracking devices compared with polysomnography

Sleep. 2021 May 14;44(5):zsaa291. doi: 10.1093/sleep/zsaa291.

Authors

Evan D Chinoy^{1

2}, Joseph A Cuellar^{1

2}, Kirbie E Huwa^{1

2}, Jason T Jameson^{1

2}, Catherine H Watson^{1

3}, Sara C Bessman^{1

4}, Dale A Hirsch¹, Adam D Cooper^{1

3}, Sean P A Drummond⁵, Rachel R Markwald¹

Affiliations

¹ Sleep, Tactical Efficiency, and Endurance Laboratory, Warfighter Performance Department, Naval Health Research Center, San Diego, CA.
² Leidos, Inc., San Diego, CA.
³ Innovative Employee Solutions, San Diego, CA.
⁴ Eagle Applied Sciences, San Diego, CA.
⁵ Turner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria, Australia.

Abstract

Study objectives: Consumer sleep-tracking devices are widely used and becoming more technologically advanced, creating strong interest from researchers and clinicians for their possible use as alternatives to standard actigraphy. We, therefore, tested the performance of many of the latest consumer sleep-tracking devices, alongside actigraphy, versus the gold-standard sleep assessment technique, polysomnography (PSG).

Methods: In total, 34 healthy young adults (22 women; 28.1 ± 3.9 years, mean ± SD) were tested on three consecutive nights (including a disrupted sleep condition) in a sleep laboratory with PSG, along with actigraphy (Philips Respironics Actiwatch 2) and a subset of consumer sleep-tracking devices. Altogether, four wearable (Fatigue Science Readiband, Fitbit Alta HR, Garmin Fenix 5S, Garmin Vivosmart 3) and three nonwearable (EarlySense Live, ResMed S+, SleepScore Max) devices were tested. Sleep/wake summary and epoch-by-epoch agreement measures were compared with PSG.

Results: Most devices (Fatigue Science Readiband, Fitbit Alta HR, EarlySense Live, ResMed S+, SleepScore Max) performed as well as or better than actigraphy on sleep/wake performance measures, while the Garmin devices performed worse. Overall, epoch-by-epoch sensitivity was high (all ≥0.93), specificity was low-to-medium (0.18-0.54), sleep stage comparisons were mixed, and devices tended to perform worse on nights with poorer/disrupted sleep.

Conclusions: Consumer sleep-tracking devices exhibited high performance in detecting sleep, and most performed equivalent to (or better than) actigraphy in detecting wake. Device sleep stage assessments were inconsistent. Findings indicate that many newer sleep-tracking devices demonstrate promising performance for tracking sleep and wake. Devices should be tested in different populations and settings to further examine their wider validity and utility.

Keywords: actigraphy; nearables; noncontact; polysomnography; sensors; sleep technology; validation; wearables.

Publication types

Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

Actigraphy*
Adult
Female
Humans
Polysomnography
Reproducibility of Results
Sleep Stages
Sleep*
Young Adult