Anatomical-functional image fusion by information of interest in local Laplacian filtering domain

IEEE Trans Image Process. 2017 Dec;26(12):5855-5866. doi: 10.1109/TIP.2017.2745202. Epub 2017 Aug 25.

Abstract

A novel method for performing anatomical (MRI)-functional (PET or SPECT) image fusion is presented. The method merges specific feature information from input image signals of a single or multiple medical imaging modalities into a single fused image while preserving more information and generating less distortion. The proposed method uses a local Laplacian filtering based technique realized through a novel multi-scale system architecture. Firstly, the input images are generated in a multi-scale image representation and are processed using local Laplacian filtering. Secondly, at each scale, the decomposed images are combined to produce fused approximate images using a local energy maximum scheme and produce the fused residual images using an information of interest-based scheme. Finally, a fused image is obtained using a reconstruction process that is analogous to that of conventional Laplacian pyramid transform. Experimental results computed using individual multi-scale analysis-based decomposition schemes or fusion rules clearly demonstrate the superiority of the proposed method through subjective observation as well as objective metrics. Furthermore, the proposed method can obtain better performance, compared to the state-of-the-art fusion methods.

MeSH terms

  • Algorithms
  • Brain / diagnostic imaging
  • Humans
  • Image Processing, Computer-Assisted / methods*
  • Magnetic Resonance Imaging
  • Multimodal Imaging / methods*