A three-dimensional virtual mouse generates synthetic training data for behavioral analysis

Nat Methods. 2021 Apr;18(4):378-381. doi: 10.1038/s41592-021-01103-9. Epub 2021 Apr 5.

Abstract

We developed a three-dimensional (3D) synthetic animated mouse based on computed tomography scans that is actuated using animation and semirandom, joint-constrained movements to generate synthetic behavioral data with ground-truth label locations. Image-domain translation produced realistic synthetic videos used to train two-dimensional (2D) and 3D pose estimation models with accuracy similar to typical manual training datasets. The outputs from the 3D model-based pose estimation yielded better definition of behavioral clusters than 2D videos and may facilitate automated ethological classification.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Animals
  • Behavior, Animal*
  • Female
  • Imaging, Three-Dimensional / methods*
  • Machine Learning
  • Mice
  • Mice, Inbred C57BL