Simple and efficient registration of 3D point cloud and image data for an indoor mobile mapping system

J Opt Soc Am A Opt Image Sci Vis. 2021 Apr 1;38(4):579-586. doi: 10.1364/JOSAA.414042.

Abstract

Registration of 3D lidar point clouds with optical images is critical in the combination of multisource data. Geometric misalignment originally exists in the pose data between lidar point clouds and optical images. To improve the accuracy of the initial pose and the applicability of the integration of 3D points and image data, we develop a simple but efficient registration method. We first extract point features from lidar point clouds and images: point features are extracted from single-frame lidar and point features are extracted from images using a classical Canny operator. The cost map is subsequently built based on Canny image edge detection. The optimization direction is guided by the cost map, where low cost represents the desired direction, and loss function is also considered to improve the robustness of the proposed method. Experiments show positive results.