3D reconstruction of structured light fields based on point cloud adaptive repair for highly reflective surfaces

Appl Opt. 2021 Aug 20;60(24):7086-7093. doi: 10.1364/AO.431538.

Abstract

In this paper, a novel method, to the best of our knowledge, of structured light fields based on point cloud adaptive repair is proposed to realize 3D reconstruction for highly reflective surfaces. We have designed and built a focused light field camera whose spatial and angular resolution can be flexibly adjusted as required. Then the subaperture image extraction algorithm based on image mosaic is deduced and presented to obtain multidirectional images. After that, the 3D reconstruction of structured light field imaging based on point cloud adaptive repair is presented to accurately reconstruct for highly reflective surfaces. In addition, a method based on smoothness and repair rate is also proposed to objectively evaluate the performance of the 3D reconstruction. Experimental results demonstrate the validity of the proposed method to perform high-quality depth reconstruction for highly reflective surfaces. Generally, our method takes advantage of the multidirectional imaging of the light field camera and can ensure good modulation effect of structured light while avoiding hardware complexity, which makes it application more convenient.