Parallax Free Registration for Augmented Reality Optical See-Through Displays in the Peripersonal Space

IEEE Trans Vis Comput Graph. 2022 Mar;28(3):1608-1618. doi: 10.1109/TVCG.2020.3021534. Epub 2022 Jan 28.

Abstract

Egocentric augmented reality (AR) interfaces are quickly becoming a key asset for assisting high precision activities in the peripersonal space in several application fields. In these applications, accurate and robust registration of computer-generated information to the real scene is hard to achieve with traditional Optical See-Through (OST) displays given that it relies on the accurate calibration of the combined eye-display projection model. The calibration is required to efficiently estimate the projection parameters of the pinhole model that encapsulate the optical features of the display and whose values vary according to the position of the user's eye. In this article, we describe an approach that prevents any parallax-related AR misregistration at a pre-defined working distance in OST displays with infinity focus; our strategy relies on the use of a magnifier placed in front of the OST display, and features a proper parameterization of the virtual rendering camera achieved through a dedicated calibration procedure that accounts for the contribution of the magnifier. We model the registration error due to the viewpoint parallax outside the ideal working distance. Finally, we validate our strategy on a OST display, and we show that sub-millimetric registration accuracy can be achieved for working distances of ±100 mm around the focal length of the magnifier.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Augmented Reality*
  • Calibration
  • Computer Graphics
  • Personal Space
  • Surgery, Computer-Assisted* / methods
  • User-Computer Interface