Tumor-Attentive Segmentation-Guided GAN for Synthesizing Breast Contrast-Enhanced MRI Without Contrast Agents

IEEE J Transl Eng Health Med. 2022 Nov 14:11:32-43. doi: 10.1109/JTEHM.2022.3221918. eCollection 2023.

Abstract

Objective: Breast dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is a sensitive imaging technique critical for breast cancer diagnosis. However, the administration of contrast agents poses a potential risk. This can be avoided if contrast-enhanced MRI can be obtained without using contrast agents. Thus, we aimed to generate T1-weighted contrast-enhanced MRI (ceT1) images from pre-contrast T1 weighted MRI (preT1) images in the breast.

Methods: We proposed a generative adversarial network to synthesize ceT1 from preT1 breast images that adopted a local discriminator and segmentation task network to focus specifically on the tumor region in addition to the whole breast. The segmentation network performed a related task of segmentation of the tumor region, which allowed important tumor-related information to be enhanced. In addition, edge maps were included to provide explicit shape and structural information. Our approach was evaluated and compared with other methods in the local (n = 306) and external validation (n = 140) cohorts. Four evaluation metrics of normalized mean squared error (NRMSE), Pearson cross-correlation coefficients (CC), peak signal-to-noise ratio (PSNR), and structural similarity index map (SSIM) for the whole breast and tumor region were measured. An ablation study was performed to evaluate the incremental benefits of various components in our approach.

Results: Our approach performed the best with an NRMSE 25.65, PSNR 54.80 dB, SSIM 0.91, and CC 0.88 on average, in the local test set.

Conclusion: Performance gains were replicated in the validation cohort.

Significance: We hope that our method will help patients avoid potentially harmful contrast agents. Clinical and Translational Impact Statement-Contrast agents are necessary to obtain DCE-MRI which is essential in breast cancer diagnosis. However, administration of contrast agents may cause side effects such as nephrogenic systemic fibrosis and risk of toxic residue deposits. Our approach can generate DCE-MRI without contrast agents using a generative deep neural network. Thus, our approach could help patients avoid potentially harmful contrast agents resulting in an improved diagnosis and treatment workflow for breast cancer.

Keywords: Breast magnetic resonance imaging; adversarial learning; image synthesis; segmentationguided; tumor-attentive.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Breast Neoplasms* / diagnostic imaging
  • Contrast Media*
  • Female
  • Humans
  • Magnetic Resonance Imaging

Substances

  • Contrast Media

Grants and funding

This work was supported in part by the National Research Foundation under Grant NRF-2020M3E5D2A01084892, in part by the Institute for Basic Science under Grant IBS-R015-D1, in part by the Ministry of Science and Information Communication Technology (ICT) under Grant IITP-2020-2018-0-01798, in part by the Institute for Information & communication Technology Planning & evaluation (IITP) Grant through the Artificial Intelligence (AI) Graduate School Support Program under Grant 2019-0-00421, in part by the ICT Creative Consilience program under Grant IITP-2020-0-01821, and in part by the Artificial Intelligence Innovation Hub program under Grant 2021-0-02068.