Validating markerless pose estimation with 3D X-ray radiography

J Exp Biol. 2022 May 1;225(9):jeb243998. doi: 10.1242/jeb.243998. Epub 2022 May 12.

Abstract

To reveal the neurophysiological underpinnings of natural movement, neural recordings must be paired with accurate tracking of limbs and postures. Here, we evaluated the accuracy of DeepLabCut (DLC), a deep learning markerless motion capture approach, by comparing it with a 3D X-ray video radiography system that tracks markers placed under the skin (XROMM). We recorded behavioral data simultaneously with XROMM and RGB video as marmosets foraged and reconstructed 3D kinematics in a common coordinate system. We used the toolkit Anipose to filter and triangulate DLC trajectories of 11 markers on the forelimb and torso and found a low median error (0.228 cm) between the two modalities corresponding to 2.0% of the range of motion. For studies allowing this relatively small error, DLC and similar markerless pose estimation tools enable the study of increasingly naturalistic behaviors in many fields including non-human primate motor control.

Keywords: Anipose; DeepLabCut; Markerless tracking; Marmoset; Pose estimation; XROMM.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.
  • Research Support, N.I.H., Extramural

MeSH terms

  • Animals
  • Biomechanical Phenomena / physiology
  • Motion
  • Movement* / physiology
  • Radiography
  • X-Rays