Influence of sampling accuracy on augmented reality for laparoscopic image-guided surgery

Minim Invasive Ther Allied Technol. 2021 Aug;30(4):229-238. doi: 10.1080/13645706.2020.1727524. Epub 2020 Mar 5.

Abstract

Purpose: This study aims to evaluate the accuracy of point-based registration (PBR) when used for augmented reality (AR) in laparoscopic liver resection surgery.

Material and methods: The study was conducted in three different scenarios in which the accuracy of sampling targets for PBR decreases: using an assessment phantom with machined divot holes, a patient-specific liver phantom with markers visible in computed tomography (CT) scans and in vivo, relying on the surgeon's anatomical understanding to perform annotations. Target registration error (TRE) and fiducial registration error (FRE) were computed using five randomly selected positions for image-to-patient registration.

Results: AR with intra-operative CT scanning showed a mean TRE of 6.9 mm for the machined phantom, 7.9 mm for the patient-specific phantom and 13.4 mm in the in vivo study.

Conclusions: AR showed an increase in both TRE and FRE throughout the experimental studies, proving that AR is not robust to the sampling accuracy of the targets used to compute image-to-patient registration. Moreover, an influence of the size of the volume to be register was observed. Hence, it is advisable to reduce both errors due to annotations and the size of registration volumes, which can cause large errors in AR systems.

Keywords: Image-guided surgery; augmented reality; hand-eye calibration; laparoscopic surgery; target registration error.

MeSH terms

  • Algorithms
  • Augmented Reality*
  • Humans
  • Imaging, Three-Dimensional
  • Laparoscopy*
  • Phantoms, Imaging
  • Surgery, Computer-Assisted*