X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module

Jinchao Feng; Hu Zhang; Mengfan Geng; Hanliang Chen; Kebin Jia; Zhonghua Sun; Zhe Li; Xu Cao; Brian W Pogue

doi:10.1117/1.JBO.28.2.026004

X-ray Cherenkov-luminescence tomography reconstruction with a three-component deep learning algorithm: Swin transformer, convolutional neural network, and locality module

J Biomed Opt. 2023 Feb;28(2):026004. doi: 10.1117/1.JBO.28.2.026004. Epub 2023 Feb 16.

Authors

Jinchao Feng^{1

2}, Hu Zhang¹, Mengfan Geng¹, Hanliang Chen¹, Kebin Jia^{1

2}, Zhonghua Sun^{1

2}, Zhe Li^{1

2}, Xu Cao³, Brian W Pogue⁴

Affiliations

¹ Beijing University of Technology, Beijing Key Laboratory of Computational Intelligence and Intelligent System, Faculty of Information Technology, Beijing, China.
² Beijing Laboratory of Advanced Information Networks, Beijing, China.
³ Xidian University, Engineering Research Center of Molecular and Neuro Imaging of the Ministry of Education and School of Life Science and Technology, Xi'an, China.
⁴ University of Wisconsin-Madison, Department of Medical Physics, Madison, Wisconsin, United States.

Abstract

Significance: X-ray Cherenkov-luminescence tomography (XCLT) produces fast emission data from megavoltage (MV) x-ray scanning, in which the excitation location of molecules within tissue is reconstructed. However standard filtered backprojection (FBP) algorithms for XCLT sinogram reconstruction can suffer from insufficient data due to dose limitations, so there are limits in the reconstruction quality with some artifacts. We report a deep learning algorithm for XCLT with high image quality and improved quantitative accuracy.

Aim: To directly reconstruct the distribution of emission quantum yield for x-ray Cherenkov-luminescence tomography, we proposed a three-component deep learning algorithm that includes a Swin transformer, convolution neural network, and locality module model.

Approach: A data-to-image model x-ray Cherenkov-luminescence tomography is developed based on a Swin transformer, which is used to extract pixel-level prior information from the sinogram domain. Meanwhile, a convolutional neural network structure is deployed to transform the extracted pixel information from the sinogram domain to the image domain. Finally, a locality module is designed between the encoder and decoder connection structures for delivering features. Its performance was validated with simulation, physical phantom, and in vivo experiments.

Results: This approach can better deal with the limits to data than conventional FBP methods. The method was validated with numerical and physical phantom experiments, with results showing that it improved the reconstruction performance mean square error ( $> 94.1 %$ ), peak signal-to-noise ratio ( $> 41.7 %$ ), and Pearson correlation ( $> 19 %$ ) compared with the FBP algorithm. The Swin-CNN also achieved a 32.1% improvement in PSNR over the deep learning method AUTOMAP.

Conclusions: This study shows that the three-component deep learning algorithm provides an effective reconstruction method for x-ray Cherenkov-luminescence tomography.

Keywords: Cherenkov imaging; Swin-transformer; deep learning; image reconstruction; x-ray Cherenkov-luminescence tomography.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Algorithms
Deep Learning*
Image Processing, Computer-Assisted / methods
Luminescence
Neural Networks, Computer
Phantoms, Imaging
Tomography, X-Ray Computed* / methods
X-Rays