Incorporation of a spectral model in a convolutional neural network for accelerated spectral fitting

Magn Reson Med. 2019 May;81(5):3346-3357. doi: 10.1002/mrm.27641. Epub 2019 Jan 21.

Abstract

Purpose: MRSI has shown great promise in the detection and monitoring of neurologic pathologies such as tumor. A necessary component of data processing includes the quantitation of each metabolite, typically done through fitting a model of the spectrum to the data. For high-resolution volumetric MRSI of the brain, which may have ~10,000 spectra, significant processing time is required for spectral analysis and generation of metabolite maps.

Methods: A novel unsupervised deep learning architecture that combines a convolutional neural network with a priori models of the spectrum is presented. This architecture, a convolutional encoder-model decoder (CEMD), combines the strengths of adaptive and unbiased convolutional networks with models of magnetic resonance and is readily interpretable.

Results: The CEMD architecture performs accurate spectral fitting for volumetric MRSI in patients with glioblastoma, provides whole-brain fitting in 1 min on a standard computer, and handles a variety of spectral artifacts.

Conclusion: A new architecture combining physics domain knowledge with convolutional neural networks has been developed and is able to perform rapid spectral fitting of whole-brain data. Rapid processing is a critical step toward routine clinical practice.

Keywords: MR spectroscopy; MRSI; brain; deep learning; machine learning; spectral analysis; spectroscopic imaging.

Publication types

  • Multicenter Study
  • Research Support, N.I.H., Extramural

MeSH terms

  • Algorithms
  • Artifacts
  • Aspartic Acid / analogs & derivatives
  • Aspartic Acid / pharmacology
  • Brain Mapping / methods*
  • Brain Neoplasms / diagnostic imaging*
  • Choline / pharmacology
  • Computer Graphics
  • Creatine / pharmacology
  • Databases, Factual
  • Deep Learning
  • Echo-Planar Imaging*
  • Glioblastoma / diagnostic imaging*
  • Humans
  • Image Processing, Computer-Assisted
  • Magnetic Resonance Spectroscopy*
  • Models, Theoretical
  • Neural Networks, Computer*
  • Signal-To-Noise Ratio
  • Software
  • User-Computer Interface
  • White Matter / diagnostic imaging*

Substances

  • Aspartic Acid
  • N-acetylaspartate
  • Creatine
  • Choline