Medical Image Fusion Method Based on Coupled Neural P Systems in Nonsubsampled Shearlet Transform Domain

Int J Neural Syst. 2021 Jan;31(1):2050050. doi: 10.1142/S0129065720500501. Epub 2020 Aug 18.

Abstract

Coupled neural P (CNP) systems are a recently developed Turing-universal, distributed and parallel computing model, combining the spiking and coupled mechanisms of neurons. This paper focuses on how to apply CNP systems to handle the fusion of multi-modality medical images and proposes a novel image fusion method. Based on two CNP systems with local topology, an image fusion framework in nonsubsampled shearlet transform (NSST) domain is designed, where the two CNP systems are used to control the fusion of low-frequency NSST coefficients. The proposed fusion method is evaluated on 20 pairs of multi-modality medical images and compared with seven previous fusion methods and two deep-learning-based fusion methods. Quantitative and qualitative experimental results demonstrate the advantage of the proposed fusion method in terms of visual quality and fusion performance.

Keywords: Medical images; coupled neural P systems; multi-modality; nonsubsampled shearlet transform.

MeSH terms

  • Algorithms*
  • Magnetic Resonance Imaging
  • Neural Networks, Computer*
  • Neurons
  • Tomography, X-Ray Computed