Real-time visualization and interaction with static and live optical coherence tomography volumes in immersive virtual reality

Biomed Opt Express. 2018 May 30;9(6):2825-2843. doi: 10.1364/BOE.9.002825. eCollection 2018 Jun 1.

Abstract

Virtual reality (VR) head-mounted displays are an attractive technology for viewing intrasurgical optical coherence tomography (OCT) volumes because they liberate surgeons from microscope oculars. We demonstrate real-time, interactive viewing of OCT volumes in a commercial HTC Vive immersive VR system using previously reported ray casting techniques. Furthermore, we show interactive manipulation and sectioning of volumes using handheld controllers and guidance of mock surgical procedures in porcine eyes exclusively within VR. To the best of our knowledge, we report the first immersive VR-OCT viewer with stereo ray casting volumetric renders, arbitrary sectioning planes, and live acquisition support. We believe VR-OCT volume displays will advance ophthalmic surgery towards VR-integrated surgery.

Keywords: (100.6890) Three-dimensional image processing; (170.4500) Optical coherence tomography; (330.4460) Ophthalmic optics and devices.