Two-Stage CNN Whole Heart Segmentation Combining Image Enhanced Attention Mechanism and Metric Classification

J Digit Imaging. 2023 Feb;36(1):124-142. doi: 10.1007/s10278-022-00708-6. Epub 2022 Sep 29.

Abstract

Accurate segmentation of multiple tissues and organs in cardiac medical imaging is of great value in computer-aided cardiovascular diagnosis. However, it is challenging due to the complex distribution of various tissues and organs in cardiac MRI (magnetic resonance imaging) slices, low discriminative and large spanning organs. To handle these problems, a two-stage CNN (convolutional neural network) segmentation method based on the combination of Log-Gabor filter attention mechanism and metric classification is proposed. The Log-Gabor filterbank is applied to selectively enhance the texture information and contour information of each tissue and organ, and the spatial and channel attention mechanism jointly with the varying kernel size of Log-Gabor filterbank is incorporated into the codec structure to adaptively extract target features of different sizes and focus on the discriminative features in the network. To solve the problem of insufficient segmentation on subtle and adherent edges involving different tissues, a metric classification network is incorporated to finely optimize the hard-to-be-segmented boundaries. The proposed method was tested on cardiac MRI data set to segment 7 cardiac tissues, and the rationality and effectiveness of the method were verified. In comparison to a series of deep learning-based segmentation models, the proposed method achieves competitive performance.

Keywords: Attention mechanism; Cardiac multi-target segmentation; Convolutional neural network; Image enhancement; Metric classification.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Diagnosis, Computer-Assisted
  • Heart
  • Humans
  • Image Processing, Computer-Assisted* / methods
  • Magnetic Resonance Imaging / methods
  • Neural Networks, Computer*