Field-based Measurement of Sleep: Agreement between Six Commercial Activity Monitors and a Validated Accelerometer

Behav Sleep Med. 2020 Sep-Oct;18(5):637-652. doi: 10.1080/15402002.2019.1651316. Epub 2019 Aug 27.

Abstract

Objective: To examine agreement between multiple commercial activity monitors (CAMs) and a validated actigraph to measure sleep.

Methods: Thirty adults without sleep disorders wore an Actiwatch Spectrum (AW) and alternated wearing 6 CAMs for one 24-h period each (Fitbit Alta, Jawbone Up3, Misfit Shine 2, Polar A360, Samsung Gear Fit2, Xiaomi Mi Band 2). Total sleep time (TST) and wake after sleep onset (WASO) were compared between edited AW and unedited CAM outputs. Comparisons between AW and CAM data were made via paired t-tests, mean absolute percent error (MAPE) calculations, and intra-class correlations (ICC). Intra-model reliability was performed in 10 participants who wore a pair of each AW and CAM model.

Results: Fitbit, Jawbone, Misfit, and Xiaomi overestimated TST relative to AW (53.7-80.4 min, P ≤ .001). WASO was underestimated by Fitbit, Misfit, Samsung and Xiaomi devices (15.0-27.9 min; P ≤ .004) and overestimated by Polar (27.7 min, P ≤ .001). MAPEs ranged from 5.1% (Samsung) to 25.4% (Misfit) for TST and from 36.6% (Fitbit) to 165.1% (Polar) for WASO. TST ICCs ranged from .00 (Polar) to .92 (Samsung), while WASO ICCs ranged from .38 (Misfit) to .69 (Samsung). Differences were similar between poor sleepers (Pittsburgh Sleep Quality Index global score >5; n = 10) and good sleepers. Intra-model reliability analyses revealed minimal between-pair differences and high ICCs.

Conclusions: Agreement between CAMs and AW varied by device, with greater agreement observed for TST than WASO. While reliable, variability in agreement across CAMs with traditional actigraphy may complicate the interpretation of CAM data obtained for clinical or research purposes.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Accelerometry / methods*
  • Actigraphy / methods*
  • Adolescent
  • Adult
  • Female
  • Humans
  • Male
  • Middle Aged
  • Reproducibility of Results
  • Sleep / physiology*
  • Young Adult