Depth image super-resolution reconstruction based on a modified joint trilateral filter

R Soc Open Sci. 2019 Jan 30;6(1):181074. doi: 10.1098/rsos.181074. eCollection 2019 Jan.

Abstract

Depth image super-resolution (SR) is a technique that uses signal processing technology to enhance the resolution of a low-resolution (LR) depth image. Generally, external database or high-resolution (HR) images are needed to acquire prior information for SR reconstruction. To overcome the limitations, a depth image SR method without reference to any external images is proposed. In this paper, a high-quality edge map is first constructed using a sparse coding method, which uses a dictionary learned from the original images at different scales. Then, the high-quality edge map is used to guide the interpolation for depth images by a modified joint trilateral filter. During the interpolation, some information of gradient and structural similarity (SSIM) are added to preserve the detailed information and suppress the noise. The proposed method can not only preserve the sharpness of image edge, but also avoid the dependence on database. Experimental results show that the proposed method is superior to some state-of-the-art depth image SR methods.

Keywords: depth image; joint trilateral filter; sparse code; super-resolution.

Associated data

  • Dryad/10.5061/dryad.5ph7sm6