Using mixed reality technique combines multimodal imaging signatures to adjuvant glioma photodynamic therapy

Jiawei Dong; Fang Wang; Yuyun Xu; Xin Gao; Hongtao Zhao; Jiheng Zhang; Nan Wang; Zhihui Liu; Xiuwei Yan; Jiaqi Jin; Hang Ji; Ruiqi Cheng; Lihai Wang; Zhaowen Qiu; Shaoshan Hu

doi:10.3389/fmed.2023.1171819

Using mixed reality technique combines multimodal imaging signatures to adjuvant glioma photodynamic therapy

Front Med (Lausanne). 2023 Jul 18:10:1171819. doi: 10.3389/fmed.2023.1171819. eCollection 2023.

Authors

Jiawei Dong^{1

2}, Fang Wang^{1

2}, Yuyun Xu³, Xin Gao², Hongtao Zhao², Jiheng Zhang^{1

2}, Nan Wang^{1

2}, Zhihui Liu^{1

2}, Xiuwei Yan^{1

2}, Jiaqi Jin^{1

2}, Hang Ji², Ruiqi Cheng⁴, Lihai Wang⁵, Zhaowen Qiu⁶, Shaoshan Hu²

Affiliations

¹ Department of Neurosurgery, The Second Affiliated Hospital of Harbin Medical University, Harbin, China.
² Cancer Center, Department of Neurosurgery, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China.
³ Cancer Center, Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, China.
⁴ Heilongjiang Tuomeng Technology Co., Ltd, Harbin, China.
⁵ College of Engineering and Technology, Northeast Forestry University, Harbin, China.
⁶ College of Information and Computer Engineering, Northeast Forestry University, Harbin, China.

Abstract

Background: Photodynamic therapy (PDT) promotes significant tumor regression and extends the lifetime of patients. The actual operation of PDT often relies on the subjective judgment of experienced neurosurgeons. Patients can benefit more from precisely targeting PDT's key operating zones.

Methods: We used magnetic resonance imaging scans and created 3D digital models of patient anatomy. Multiple images are aligned and merged in STL format. Neurosurgeons use HoloLens to import reconstructions and assist in PDT execution. Also, immunohistochemistry was used to explore the association of hyperperfusion sites in PDT of glioma with patient survival.

Results: We constructed satisfactory 3D visualization of glioma models and accurately localized the hyperperfused areas of the tumor. Tumor tissue taken in these areas was rich in CD31, VEGFA and EGFR that were associated with poor prognosis in glioma patients. We report the first study using MR technology combined with PDT in the treatment of glioma. Based on this model, neurosurgeons can focus PDT on the hyperperfused area of the glioma. A direct benefit was expected for the patients in this treatment.

Conclusion: Using the Mixed Reality technique combines multimodal imaging signatures to adjuvant glioma PDT can better exploit the vascular sealing effect of PDT on glioma.

Keywords: HoloLens; glioma; magnetic resonance imaging; mixed reality; photodynamic therapy.