(An overview of) Synergistic reconstruction for multimodality/multichannel imaging methods

Philos Trans A Math Phys Eng Sci. 2021 Jun 28;379(2200):20200205. doi: 10.1098/rsta.2020.0205. Epub 2021 May 10.

Abstract

Imaging is omnipresent in modern society with imaging devices based on a zoo of physical principles, probing a specimen across different wavelengths, energies and time. Recent years have seen a change in the imaging landscape with more and more imaging devices combining that which previously was used separately. Motivated by these hardware developments, an ever increasing set of mathematical ideas is appearing regarding how data from different imaging modalities or channels can be synergistically combined in the image reconstruction process, exploiting structural and/or functional correlations between the multiple images. Here we review these developments, give pointers to important challenges and provide an outlook as to how the field may develop in the forthcoming years. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 1'.

Keywords: inverse problems; multi-modality imaging; regularization; synergistic image reconstruction.

Publication types

  • Review

MeSH terms

  • Algorithms
  • Bayes Theorem
  • Biophysical Phenomena
  • Diagnostic Imaging / methods
  • Diagnostic Imaging / statistics & numerical data
  • Diagnostic Imaging / trends
  • Humans
  • Image Interpretation, Computer-Assisted / methods*
  • Image Interpretation, Computer-Assisted / statistics & numerical data
  • Likelihood Functions
  • Machine Learning
  • Magnetic Resonance Imaging / methods
  • Magnetic Resonance Imaging / statistics & numerical data
  • Markov Chains
  • Mathematical Concepts
  • Multimodal Imaging / methods*
  • Multimodal Imaging / statistics & numerical data
  • Multimodal Imaging / trends
  • Neural Networks, Computer
  • Positron-Emission Tomography / methods
  • Positron-Emission Tomography / statistics & numerical data