Feature interaction network based on hierarchical decoupled convolution for 3D medical image segmentation

PLoS One. 2023 Jul 13;18(7):e0288658. doi: 10.1371/journal.pone.0288658. eCollection 2023.

Abstract

Manual image segmentation consumes time. An automatic and accurate method to segment multimodal brain tumors using context information rich three-dimensional medical images that can be used for clinical treatment decisions and surgical planning is required. However, it is a challenge to use deep learning to achieve accurate segmentation of medical images due to the diversity of tumors and the complex boundary interactions between sub-regions while limited computing resources hinder the construction of efficient neural networks. We propose a feature fusion module based on a hierarchical decoupling convolution network and an attention mechanism to improve the performance of network segmentation. We replaced the skip connections of U-shaped networks with a feature fusion module to solve the category imbalance problem, thus contributing to the segmentation of more complicated medical images. We introduced a global attention mechanism to further integrate the features learned by the encoder and explore the context information. The proposed method was evaluated for enhance tumor, whole tumor, and tumor core, achieving Dice similarity coefficient metrics of 0.775, 0.900, and 0.827, respectively, on the BraTS 2019 dataset and 0.800, 0.902, and 0.841, respectively on the BraTS 2018 dataset. The results show that our proposed method is inherently general and is a powerful tool for brain tumor image studies. Our code is available at: https://github.com/WSake/Feature-interaction-network-based-on-Hierarchical-Decoupled-Convolution.

MeSH terms

  • Benchmarking
  • Brain Neoplasms* / diagnostic imaging
  • Humans
  • Image Processing, Computer-Assisted
  • Neural Networks, Computer

Grants and funding

Longfeng Shen received the University Synergy Innovation Program of Anhui Province, China (GXXT-2022-033), Anhui Provincial universities outstanding young backbone talents domestic visiting study and Research project (Grant No.gxgnfx2019006), the projects of Natural Science Foundation of Anhui Provincial Department of Education (Grant No: KJ2019A0603), and Open Laboratory project of Huaibei Normal University(Grant No: 2022sykf048). Dengdi Sun received the University Synergy Innovation Program of Anhui Province, China (GXXT-2022-002). Qianqian Meng received the projects of Natural Science Foundation of Anhui Provincial Department of Education (Grant No: KJ2020B13). Yingjie Zhang received Open Laboratory project of Huaibei Normal University(Grant No: 2021sykf027) and 2022 National Innovation and Entrepreneurship Training Program for College Students (202210373005). Qiong Wang received Open Laboratory project of Huaibei Normal University(Grant No: 2022sykf049). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.