A robust transformer-based pipeline of 3D cell alignment, denoise and instance segmentation on electron microscopy sequence images

Abstract

Germline cells are critical for transmitting genetic information to subsequent generations in biological organisms. While their differentiation from somatic cells during embryonic development is well-documented in most animals, the regulatory mechanisms initiating plant germline cells are not well understood. To thoroughly investigate the complex morphological transformations of their ultrastructure over developmental time, nanoscale 3D reconstruction of entire plant tissues is necessary, achievable exclusively through electron microscopy imaging. This paper presents a full-process framework designed for reconstructing large-volume plant tissue from serial electron microscopy images. The framework ensures end-to-end direct output of reconstruction results, including topological networks and morphological analysis. The proposed 3D cell alignment, denoise, and instance segmentation pipeline (3DCADS) leverages deep learning to provide a cell instance segmentation workflow for electron microscopy image series, ensuring accurate and robust 3D cell reconstructions with high computational efficiency. The pipeline involves five stages: the registration of electron microscopy serial images; image enhancement and denoising; semantic segmentation using a Transformer-based neural network; instance segmentation through a supervoxel-based clustering algorithm; and an automated analysis and statistical assessment of the reconstruction results, with the mapping of topological connections. The 3DCADS model's precision was validated on a plant tissue ground-truth dataset, outperforming traditional baseline models and deep learning baselines in overall accuracy. The framework was applied to the reconstruction of early meiosis stages in the anthers of Arabidopsis thaliana, resulting in a topological connectivity network and analysis of morphological parameters and characteristics of cell distribution. The experiment underscores the 3DCADS model's potential for biological tissue identification and its significance in quantitative analysis of plant cell development, crucial for examining samples across different genetic phenotypes and mutations in plant development. Additionally, the paper discusses the regulatory mechanisms of Arabidopsis thaliana's germline cells and the development of stamen cells before meiosis, offering new insights into the transition from somatic to germline cell fate in plants.

Keywords: 3D reconstruction; 3DCADS; Electron microscopy; Stamen cells; Topological analysis.