Automatic left ventricle volume calculation with explainability through a deep learning weak-supervision methodology

Comput Methods Programs Biomed. 2021 Sep:208:106275. doi: 10.1016/j.cmpb.2021.106275. Epub 2021 Jul 9.

Abstract

Background and objective: Magnetic resonance imaging is the most reliable imaging technique to assess the heart. More specifically there is great importance in the analysis of the left ventricle, as the main pathologies directly affect this region. In order to characterize the left ventricle, it is necessary to extract its volume. In this work we present a neural network architecture that is capable of directly estimating the left ventricle volume in short axis cine Magnetic Resonance Imaging in the end-diastolic frame and provide a segmentation of the region which is the basis of the volume calculation, thus offering explainability to the estimated value.

Methods: The network was designed to directly target the volumes to estimate, not requiring any labeled segmentation on the images. The network was based on a 3D U-net with extra layers defined in a scanning module that learned features like the circularity of the objects and the volumes to estimate in a weakly-supervised manner. The only targets defined were the left ventricle volumes and the circularity of the object detected through the estimation of the π value derived from its shape. We had access to 397 cases corresponding to 397 different subjects. We randomly selected 98 cases to use as test set.

Results: The results show a good match between the real and estimated volumes in the test set, with a mean relative error of 8% and a mean absolute error of 9.12 ml with a Pearson correlation coefficient of 0.95. The derived segmentations obtained by the network achieved Dice coefficients with a mean value of 0.79.

Conclusions: The proposed method is capable of obtaining the left ventricle volume biomarker in the end-diastole and offer an explanation of how it obtains the result in the form of a segmentation mask without the need of segmentation labels to train the algorithm, making it a potentially more trustworthy method for clinicians and a way to train neural networks more easily when segmentation labels are not readily available.

Keywords: Deep learning; Explainability; Left ventricle; Magnetic resonance imaging; Segmentation; Weak supervision.

MeSH terms

  • Deep Learning*
  • Heart
  • Heart Ventricles* / diagnostic imaging
  • Humans
  • Image Processing, Computer-Assisted
  • Magnetic Resonance Imaging
  • Magnetic Resonance Imaging, Cine
  • Neural Networks, Computer