A stochastic algorithm for automatic hand pose and motion estimation

Med Biol Eng Comput. 2017 Dec;55(12):2197-2208. doi: 10.1007/s11517-017-1654-6. Epub 2017 Jun 8.

Abstract

In this paper, a novel, robust, and simple method for automatically estimating the hand pose is proposed and validated. The method uses a multi-camera optoelectronic system and a model-based stochastic algorithm. The approach is marker-based and relies on an Unscented Kalman Filter. A hand kinematic model is introduced for constraining relative marker's positions and improving the algorithm robustness with respect to outliers and possible occlusions. The algorithm outputs are 3D coordinate measures of markers and hand joint angle values. To validate the proposed algorithm, a comparison with ground truths for angular and 3D coordinate measures is carried out. The comparative analysis shows the advantages of using the model-based stochastic algorithm with respect to standard processing software of optoelectronic cameras in terms of implementation simplicity, time consumption, and user effort. The accuracy is remarkable, with a difference of maximum 0.035r a d and 4m m with respect to angular and 3D Cartesian coordinates ground truths, respectively.

Keywords: Hand motion analysis; Hand pose estimation; Optoelectronic cameras; Unscented Kalman filter.

MeSH terms

  • Algorithms*
  • Hand / physiology*
  • Humans
  • Image Processing, Computer-Assisted / methods*
  • Models, Biological*
  • Movement / physiology*
  • Robotics
  • Stochastic Processes
  • Video Recording / methods