A Rendering Engine for Integral Imaging in Augmented Reality Guided Surgery

Annu Int Conf IEEE Eng Med Biol Soc. 2022 Jul:2022:2693-2696. doi: 10.1109/EMBC48229.2022.9871806.

Abstract

In the field of image-guided surgery, Augmented Reality wearable displays are a widely studied and documented technology for their ability to provide egocentric vision together with the overlap between real and virtual content. In particular, optical see-through (OST) displays have the advantage of maintaining visual perception of the real world. However, OST displays suffer from vergeance-accomodation conflict when virtual content is superimposed on real world. Furthermore, the calibration methods required to achieve geometric consistency between real and virtual are inherently error-prone. One of the solutions, already studied, to these problems is to use of integral imaging displays. In this paper we present an easy and straightforward real-time rendering strategy implemented in modern OpenGL to show the 3D image of a virtual object on a wearable OST display deploying the integral imaging approach. Clinical Relevance- The algorithm proposed open the way towards more effective AR surgical navigation in terms of comfort of the AR experience and accuracy of the AR guidance.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Augmented Reality*
  • Imaging, Three-Dimensional / methods
  • Surgery, Computer-Assisted* / methods
  • User-Computer Interface