Video see-through augmented reality for oral and maxillofacial surgery

Int J Med Robot. 2017 Jun;13(2). doi: 10.1002/rcs.1754. Epub 2016 Jun 9.

Abstract

Background: Oral and maxillofacial surgery has not been benefitting from image guidance techniques owing to the limitations in image registration.

Methods: A real-time markerless image registration method is proposed by integrating a shape matching method into a 2D tracking framework. The image registration is performed by matching the patient's teeth model with intraoperative video to obtain its pose. The resulting pose is used to overlay relevant models from the same CT space on the camera video for augmented reality.

Results: The proposed system was evaluated on mandible/maxilla phantoms, a volunteer and clinical data. Experimental results show that the target overlay error is about 1 mm, and the frame rate of registration update yields 3-5 frames per second with a 4 K camera.

Conclusions: The significance of this work lies in its simplicity in clinical setting and the seamless integration into the current medical procedure with satisfactory response time and overlay accuracy. Copyright © 2016 John Wiley & Sons, Ltd.

Keywords: 3D-2D image registration; augmented reality; object tracking; oral and maxillofacial surgery.

MeSH terms

  • Humans
  • Jaw / diagnostic imaging*
  • Oral Surgical Procedures / methods*
  • Orthognathic Surgical Procedures*
  • Phantoms, Imaging
  • Radiographic Image Enhancement / methods
  • Reproducibility of Results
  • Sensitivity and Specificity
  • Subtraction Technique*
  • Surgery, Computer-Assisted / methods*
  • Tomography, X-Ray Computed / methods*
  • User-Computer Interface*
  • Video Recording / methods