Mobile augmented reality based indoor map for improving geo-visualization

PeerJ Comput Sci. 2021 Sep 2:7:e704. doi: 10.7717/peerj-cs.704. eCollection 2021.

Abstract

Unlike traditional visualization methods, augmented reality (AR) inserts virtual objects and information directly into digital representations of the real world, which makes these objects and data more easily understood and interactive. The integration of AR and GIS is a promising way to display spatial information in context. However, most existing AR-GIS applications only provide local spatial information in a fixed location, which is exposed to a set of problems, limited legibility, information clutter and the incomplete spatial relationships. In addition, the indoor space structure is complex and GPS is unavailable, so that indoor AR systems are further impeded by the limited capacity of these systems to detect and display location and semantic information. To address this problem, the localization technique for tracking the camera positions was fused by Bluetooth low energy (BLE) and pedestrian dead reckoning (PDR). The multi-sensor fusion-based algorithm employs a particle filter. Based on the direction and position of the phone, the spatial information is automatically registered onto a live camera view. The proposed algorithm extracts and matches a bounding box of the indoor map to a real world scene. Finally, the indoor map and semantic information were rendered into the real world, based on the real-time computed spatial relationship between the indoor map and live camera view. Experimental results demonstrate that the average positioning error of our approach is 1.47 m, and 80% of proposed method error is within approximately 1.8 m. The positioning result can effectively support that AR and indoor map fusion technique links rich indoor spatial information to real world scenes. The method is not only suitable for traditional tasks related to indoor navigation, but it is also promising method for crowdsourcing data collection and indoor map reconstruction.

Keywords: BLE and PDR fusion; Geo-visualization; Indoor localization; Indoor map; Mobile augmented reality.

Grants and funding

This work was supported by the National Natural Science Foundation of China (No. 42001324, 42001404), the Open Fund of Hunan Key Laboratory of Smart Roadway and Cooperative Vehicle-Infrastructure Systems (Changsha University of Science & Technology, No. kfj190703), the Guangxi Key Laboratory of Spatial Information and Geomatics (19-050-11-04), and the Beijing Key Laboratory of Urban Spatial Information Engineering, NO. 2020211. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.