Reliable image dehazing by NeRF

Opt Express. 2024 Jan 29;32(3):3528-3550. doi: 10.1364/OE.514044.

Abstract

Image dehazing is a typical low-level visual task. With the continuous improvement of network performance and the introduction of various prior knowledge, the ability of image dehazing is becoming stronger. However, the existing dehazing methods have problems such as the inability to obtain real shooting datasets, unreliable dehazing processes, and the difficulty to deal with complex lighting scenes. To solve these problems, we propose a new haze model combining the optical scattering model and the computer graphics rendering. Based on the new haze model, we propose a high-quality and widely applicable dehazing dataset generation pipeline that does not require paired-data training and prior knowledge. We reconstruct the three-dimensional fog space with array camera and remove haze by thresholding voxel deletion. We use the Unreal Engine 5 to generate simulation datasets and the real shooting in laboratory to verify the effectiveness and the reliability of our generation pipeline. Through our pipeline, we can obtain wonderful dehaze results and dehaze datasets under various complex outdoors lighting conditions. We also propose a dehaze dataset enhancement method based on voxel control. Our pipeline and data enhancement are suitable for the latest algorithm model, these solutions can obtain better visual effects and objective indicators.