Multimodal fusion of tomographic sequences of medical images: MRE spatially enhanced by MRI

Background and objective: In biomedical fields, image analysis is often necessary for an accurate diagnosis. In order to obtain all the information needed to form an in-depth clinical picture, it may be useful to combine the contents of images taken under different diagnostic modes. Multimodal medical image fusion techniques enable complementary information acquired by different imaging devices to be automatically combined into a unique image.

Methods: In this paper, multimodal medical images fusion method based on multiresolution analysis (MRA) is proposed, with the aim to combine the high geometric content of magnetic resonance imaging (MRI) and the elasticity information of magnetic resonance elastography (MRE), simultaneously acquired on the same organs of a patient. First, the slices of MRE are volumetrically interpolated to exactly overlap, each with a slice of MRI. Then, the spatial details of MRI are extracted by means of MRA and injected into the corresponding slices of MRE. Due to the intrinsic dissimilarity between corresponding slices of MRE and MRI, the spatial details of MRI are modulated by local or global matching functions.

Results: The performance of the proposed method is quantitatively assessed considering radiometric and geometric consistency of the fused images with respect to their originals, in a comparison with two popular methods from the literature. For a qualitative evaluation, a visual inspection is carried out.

Conclusions: The results show that the proposed method enables an effective MRI-MRE fusion that allows the elasticity information and geometric details of the examined organs to be evaluated in a single image.