Development of a gold-standard method for the identification of sedentary, light and moderate physical activities in older adults: Definitions for video annotation

Abstract

Objectives: The development of a reliable method for the identification of sedentary, light and moderate physical activities in older adults. The method consists of a validated set of definitions for the identification of the initiation and termination of physical activities performed by older adult participants, video recorded during free-living and a laboratory setting.

Design: Inter-rater reliability assessment in a fully crossed design.

Methods: An iterative consensus process was used to define the initiation and termination of common activities of daily living. These definitions were then tested using videos recorded in two scenarios (1) by 9 raters who annotated a video recording, of a free-living protocol in a home environment, recorded in a first person view, using a body-worn camera and (2) by 7 raters who annotated a video recording, of older adults performing a semi-structured protocol in a living-lab environment, recorded in a third person view, using wall mounted cameras.

Results: Inter-rater reliability was excellent for all items, with Krippendorff's alpha and Fleiss' kappa all above 0.84 and a percentage of agreement above 88%. All ICC(C,1) inter-rater values for the activity quantity and duration were all above 0.9.

Conclusions: This set of physical activity initiation and termination definitions offers independent researchers a gold standard method to allow for the consistent annotation of high-frequency video footage (25fps), in both a free-living and laboratory setting. When synchronised with body-worn or ambient sensors, this annotation will allow for the development and validation of physical activity classification systems to a higher resolution than before.

Keywords: Human activity recognition; Physical activity definitions; Video gold standard.