Walking Speed Classification from Marker-Free Video Images in Two-Dimension Using Optimum Data and a Deep Learning Method

Bioengineering (Basel). 2022 Nov 19;9(11):715. doi: 10.3390/bioengineering9110715.

Abstract

Walking speed is considered a reliable assessment tool for any movement-related functional activities of an individual (i.e., patients and healthy controls) by caregivers and clinicians. Traditional video surveillance gait monitoring in clinics and aged care homes may employ modern artificial intelligence techniques to utilize walking speed as a screening indicator of various physical outcomes or accidents in individuals. Specifically, ratio-based body measurements of walking individuals are extracted from marker-free and two-dimensional video images to create a walk pattern suitable for walking speed classification using deep learning based artificial intelligence techniques. However, the development of successful and highly predictive deep learning architecture depends on the optimal use of extracted data because redundant data may overburden the deep learning architecture and hinder the classification performance. The aim of this study was to investigate the optimal combination of ratio-based body measurements needed for presenting potential information to define and predict a walk pattern in terms of speed with high classification accuracy using a deep learning-based walking speed classification model. To this end, the performance of different combinations of five ratio-based body measurements was evaluated through a correlation analysis and a deep learning-based walking speed classification test. The results show that a combination of three ratio-based body measurements can potentially define and predict a walk pattern in terms of speed with classification accuracies greater than 92% using a bidirectional long short-term memory deep learning method.

Keywords: bi-LSTM; deep learning; marker-free video; optimal feature; ratio-based body measurement; redundant feature; two-dimensional (2D) image; walking speed; walking speed classification.

Grants and funding

This research received no external funding.