Mixed Reality Improves 3D Visualization and Spatial Awareness of Bone Tumors for Surgical Planning in Orthopaedic Oncology: A Proof of Concept Study

Kwok Chuen Wong; Edgar Yan Sun; Irene Oi Ling Wong; Shekhar Madhukar Kumta

doi:10.2147/ORR.S421077

Mixed Reality Improves 3D Visualization and Spatial Awareness of Bone Tumors for Surgical Planning in Orthopaedic Oncology: A Proof of Concept Study

Orthop Res Rev. 2023 Jul 31:15:139-149. doi: 10.2147/ORR.S421077. eCollection 2023.

Authors

Kwok Chuen Wong¹, Edgar Yan Sun², Irene Oi Ling Wong³, Shekhar Madhukar Kumta⁴

Affiliations

¹ Orthopaedic Oncology, Department of Orthopaedics and Traumatology, Prince of Wales Hospital, the Chinese University of Hong Kong, Hong Kong SAR, People's Republic of China.
² Independent Contractor, Hong Kong SAR, People's Republic of China.
³ School of Public Health, Li Ka Shing Faculty of Medicine, the University of Hong Kong, Hong Kong SAR, People's Republic of China.
⁴ Northern Health Precinct and Department of Surgery, The University of Melbourne, The Northern Hospital, Melbourne, VIC, Australia.

Abstract

Introduction: In orthopedic oncology, computer navigation and 3D-printed guides facilitate precise osteotomies only after surgical exposure. Before surgeries start, it is challenging to mentally process and superimpose the virtual medical images onto patients' anatomy for preoperative surgical planning. Mixed Reality (MR) is an immersive technology merging real and virtual worlds, and users can interact with digital objects in real time. Through Head-Mounted Displays, surgeons directly visualize holographic models that overlaid on tumor patients. The technology may facilitate surgical planning before skin incisions.

Methods: Nine bone tumor patients were included (July 2021 - Dec 2022). There were six primary bone sarcomas, two benign bone tumors, and one revision pelvic prosthesis. MR applications were created using patients' preoperative medical images. The surgeon examined each patient clinically using the conventional method of viewing 2D images and MR via HMD, Hololens 2. A Likert-Scale (LS) questionnaire and The National Aeronautics and Space Administration-Task Load Index (NASA-TLX) score were used to evaluate and compare the effectiveness of surgical planning and the surgeon's clinical cognitive workload for the two methods.

Results: The qualitative survey of the LS questionnaire suggested that the MR group had superior spatial awareness of tumors and was considered more effective as a preoperative planning tool than the conventional group. For NASA-TLX scores, the overall cognitive workload was lower in MR 3D hologram group than in the 2D Group for preoperative clinical assessment. When using MR technology with HMDs, the surgeon reported no discomfort.

Conclusion: MR technology may improve 3D visualization and spatial awareness of bone tumors in patients' anatomies and may facilitate surgical planning before skin incisions in orthopedic oncology surgery. With less cognitive load and better ergonomics, surgeons can focus on patients and surgical tasks with MR technology. Further studies must investigate whether MR technology improves clinical outcomes.

Keywords: 3D printing; computer navigation; holograms; mixed reality; spatial awareness.

Grants and funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.