Background: Wrist-worn devices that incorporate photoplethysmography (PPG) sensing represent an exciting means of measuring heart rate (HR). A number of studies have evaluated the accuracy of HR measurements produced by these devices in controlled laboratory environments. However, it is also important to establish the accuracy of measurements produced by these devices outside the laboratory, in real-world, consumer use conditions.
Objective: This study sought to examine the accuracy of HR measurements produced by the Withings ScanWatch during free-living activities.
Methods: A sample of convenience of 7 participants volunteered (3 male and 4 female; mean age 64, SD 10 years; mean height 164, SD 4 cm; mean weight 77, SD 16 kg) to take part in this real-world validation study. Participants were instructed to wear the ScanWatch for a 12-hour period on their nondominant wrist as they went about their day-to-day activities. A Polar H10 heart rate sensor was used as the criterion measure of HR. Participants used a study diary to document activities undertaken during the 12-hour study period. These activities were classified according to the 11 following domains: desk work, eat or drink, exercise, gardening, household activities, self-care, shopping, sitting, sleep, travel, and walking. Validity was assessed using the Bland-Altman analysis, concordance correlation coefficient (CCC), and mean absolute percentage error (MAPE).
Results: Across all activity domains, the ScanWatch measured HR with MAPE values <10%, except for the shopping activity domain (MAPE=10.8%). The activity domains that were more sedentary in nature (eg, desk work, eat or drink, and sitting) produced the most accurate HR measurements with a small mean bias and MAPE values <5%. Moderate to strong correlations (CCC=0.526-0.783) were observed between devices for all activity domains, except during the walking activity domain, which demonstrated a weak correlation (CCC=0.164) between devices.
Conclusions: The results of this study show that the ScanWatch measures HR with a degree of accuracy that is acceptable for general consumer use; however, it would not be suitable in circumstances where more accurate measurements of HR are required, such as in health care or in clinical trials. Overall, the ScanWatch was less accurate at measuring HR during ambulatory activities (eg, walking, gardening, and household activities) compared to more sedentary activities (eg, desk work, eat or drink, and sitting). Further larger-scale studies examining this device in different populations and during different activities are required.
Keywords: PPG; activity; free-living activity; heart; heart rate; photoplethysmography; physical activity; validation study; wearable electronic device; wrist-worn device.
©Oonagh M Giggins, Julie Doyle, Suzanne Smith, Daniel R Crabtree, Matthew Fraser. Originally published in JMIR Formative Research (https://formative.jmir.org), 01.09.2022.