Quantitative analysis of metastatic breast cancer in mice using deep learning on cryo-image data

Sci Rep. 2021 Sep 1;11(1):17527. doi: 10.1038/s41598-021-96838-y.

Abstract

Cryo-imaging sections and images a whole mouse and provides ~ 120-GBytes of microscopic 3D color anatomy and fluorescence images, making fully manual analysis of metastases an onerous task. A convolutional neural network (CNN)-based metastases segmentation algorithm included three steps: candidate segmentation, candidate classification, and semi-automatic correction of the classification result. The candidate segmentation generated > 5000 candidates in each of the breast cancer-bearing mice. Random forest classifier with multi-scale CNN features and hand-crafted intensity and morphology features achieved 0.8645 ± 0.0858, 0.9738 ± 0.0074, and 0.9709 ± 0.0182 sensitivity, specificity, and area under the curve (AUC) of the receiver operating characteristic (ROC), with fourfold cross validation. Classification results guided manual correction by an expert with our in-house MATLAB software. Finally, 225, 148, 165, and 344 metastases were identified in the four cancer mice. With CNN-based segmentation, the human intervention time was reduced from > 12 to ~ 2 h. We demonstrated that 4T1 breast cancer metastases spread to the lung, liver, bone, and brain. Assessing the size and distribution of metastases proves the usefulness and robustness of cryo-imaging and our software for evaluating new cancer imaging and therapeutics technologies. Application of the method with only minor modification to a pancreatic metastatic cancer model demonstrated generalizability to other tumor models.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Animals
  • Bone Neoplasms / diagnostic imaging*
  • Bone Neoplasms / secondary
  • Brain Neoplasms / diagnostic imaging*
  • Brain Neoplasms / secondary
  • Deep Learning*
  • Female
  • Image Processing, Computer-Assisted
  • Liver Neoplasms / diagnostic imaging*
  • Liver Neoplasms / secondary
  • Lung Neoplasms / diagnostic imaging*
  • Lung Neoplasms / secondary
  • Mammary Neoplasms, Experimental / diagnostic imaging*
  • Mammary Neoplasms, Experimental / pathology
  • Mice
  • Neural Networks, Computer