Mobile-Based 3D Modeling: An In-Depth Evaluation for the Application in Indoor Scenarios

J Imaging. 2021 Aug 29;7(9):167. doi: 10.3390/jimaging7090167.

Abstract

Indoor environment modeling has become a relevant topic in several application fields, including augmented, virtual, and extended reality. With the digital transformation, many industries have investigated two possibilities: generating detailed models of indoor environments, allowing viewers to navigate through them; and mapping surfaces so as to insert virtual elements into real scenes. The scope of the paper is twofold. We first review the existing state-of-the-art (SoA) of learning-based methods for 3D scene reconstruction based on structure from motion (SFM) that predict depth maps and camera poses from video streams. We then present an extensive evaluation using a recent SoA network, with particular attention on the capability of generalizing on new unseen data of indoor environments. The evaluation was conducted by using the absolute relative (AbsRel) measure of the depth map prediction as the baseline metric.

Keywords: 3D reconstruction; computer vision; deep learning; digital twin; indoor; point cloud.