A Review: Point Cloud-Based 3D Human Joints Estimation

Sensors (Basel). 2021 Mar 1;21(5):1684. doi: 10.3390/s21051684.

Abstract

Joint estimation of the human body is suitable for many fields such as human-computer interaction, autonomous driving, video analysis and virtual reality. Although many depth-based researches have been classified and generalized in previous review or survey papers, the point cloud-based pose estimation of human body is still difficult due to the disorder and rotation invariance of the point cloud. In this review, we summarize the recent development on the point cloud-based pose estimation of the human body. The existing works are divided into three categories based on their working principles, including template-based method, feature-based method and machine learning-based method. Especially, the significant works are highlighted with a detailed introduction to analyze their characteristics and limitations. The widely used datasets in the field are summarized, and quantitative comparisons are provided for the representative methods. Moreover, this review helps further understand the pertinent applications in many frontier research directions. Finally, we conclude the challenges involved and problems to be solved in future researches.

Keywords: action recognition; computer vision; convolutional neural network; deformation model; depth sensor; geodesic features; global features; hand pose tracking; human representation; joint estimation; point cloud; random forest; random tree walk; skeleton extraction; skeleton tracking.

Publication types

  • Review

MeSH terms

  • Cloud Computing*
  • Computers
  • Humans
  • Machine Learning*