DeepProjection: specific and robust projection of curved 2D tissue sheets from 3D microscopy using deep learning

Development. 2022 Nov 1;149(21):dev200621. doi: 10.1242/dev.200621. Epub 2022 Nov 11.

Abstract

The efficient extraction of image data from curved tissue sheets embedded in volumetric imaging data remains a serious and unsolved problem in quantitative studies of embryogenesis. Here, we present DeepProjection (DP), a trainable projection algorithm based on deep learning. This algorithm is trained on user-generated training data to locally classify 3D stack content, and to rapidly and robustly predict binary masks containing the target content, e.g. tissue boundaries, while masking highly fluorescent out-of-plane artifacts. A projection of the masked 3D stack then yields background-free 2D images with undistorted fluorescence intensity values. The binary masks can further be applied to other fluorescent channels or to extract local tissue curvature. DP is designed as a first processing step than can be followed, for example, by segmentation to track cell fate. We apply DP to follow the dynamic movements of 2D-tissue sheets during dorsal closure in Drosophila embryos and of the periderm layer in the elongating Danio embryo. DeepProjection is available as a fully documented Python package.

Keywords: 2D projection; 3D image analysis; Deep learning; Software; Tissue morphogenesis.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Artifacts
  • Deep Learning*
  • Image Processing, Computer-Assisted / methods
  • Imaging, Three-Dimensional / methods
  • Microscopy* / methods