NeuroConstruct: 3D Reconstruction and Visualization of Neurites in Optical Microscopy Brain Images

IEEE Trans Vis Comput Graph. 2022 Dec;28(12):4951-4965. doi: 10.1109/TVCG.2021.3109460. Epub 2022 Oct 26.

Abstract

We introduce NeuroConstruct, a novel end-to-end application for the segmentation, registration, and visualization of brain volumes imaged using wide-field microscopy. NeuroConstruct offers a Segmentation Toolbox with various annotation helper functions that aid experts to effectively and precisely annotate micrometer resolution neurites. It also offers an automatic neurites segmentation using convolutional neuronal networks (CNN) trained by the Toolbox annotations and somas segmentation using thresholding. To visualize neurites in a given volume, NeuroConstruct offers a hybrid rendering by combining iso-surface rendering of high-confidence classified neurites, along with real-time rendering of raw volume using a 2D transfer function for voxel classification score versus voxel intensity value. For a complete reconstruction of the 3D neurites, we introduce a Registration Toolbox that provides automatic coarse-to-fine alignment of serially sectioned samples. The quantitative and qualitative analysis show that NeuroConstruct outperforms the state-of-the-art in all design aspects. NeuroConstruct was developed as a collaboration between computer scientists and neuroscientists, with an application to the study of cholinergic neurons, which are severely affected in Alzheimer's disease.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.
  • Research Support, N.I.H., Extramural

MeSH terms

  • Brain* / diagnostic imaging
  • Computer Graphics
  • Image Processing, Computer-Assisted / methods
  • Imaging, Three-Dimensional* / methods
  • Microscopy*
  • Neural Networks, Computer*
  • Neurites