Implementation of augmented reality support in spine surgery

Eur Spine J. 2019 Jul;28(7):1697-1711. doi: 10.1007/s00586-019-05969-4. Epub 2019 Apr 5.

Abstract

Purpose: To implement a straightforward workflow that allows to establish augmented reality (AR) support in spine surgery.

Methods: Intraoperative computed tomography (iCT) applying a 32-slice movable scanner was used for navigation registration in a series of 10 patients who underwent surgery for extra- or intradural spinal lesions. Preoperative multimodal image data were integrated by nonlinear registration with the iCT images. Automatic segmentation was used to delineate the 3-dimensional (3-D) outline of the vertebra, and in addition, the tumor extent, as well as implants, was segmented and visualized.

Results: Automatic patient registration without user interaction resulted in high navigation accuracy with a mean registration error of only about 1 mm. Moreover, the workflow for establishing AR was straightforward and could be easily integrated in the normal surgical procedure. Low-dose iCT protocols resulted in a radiation exposure of 0.35-0.98 mSv for cervical, 2.16-6.92 mSv for thoracic, and 3.55-4.20 mSv for lumbar surgeries, which is a reduction in the effective radiation dose by 70%. The segmented structures were intuitively visualized in the surgical field using the heads-up display of the operating microscope. In parallel, the microscope video was superimposed with the segmented 3-D structures, which were visualized in a semitransparent manner along with various display modes of the image data.

Conclusions: A microscope-based AR environment was successfully implemented for spinal surgery. The application of iCT for registration imaging ensures high navigational accuracy. AR greatly supports the surgeon in understanding the 3-D anatomy thereby facilitating surgery. These slides can be retrieved under Electronic Supplementary Material.

Keywords: Augmented reality; Intraoperative computed tomography; Low-dose computed tomography; Navigation registration; Spine tumor surgery.

MeSH terms

  • Adult
  • Aged
  • Augmented Reality*
  • Female
  • Humans
  • Imaging, Three-Dimensional*
  • Male
  • Middle Aged
  • Multidetector Computed Tomography*
  • Orthopedic Procedures / methods*
  • Outcome Assessment, Health Care
  • Retrospective Studies
  • Spine / surgery*
  • Surgery, Computer-Assisted / methods*