Spectral reflectance estimation from one RGB image using self-interreflections in a concave object

Appl Opt. 2018 Jun 10;57(17):4918-4929. doi: 10.1364/AO.57.004918.

Abstract

Light interreflections occurring in a concave object generate a color gradient that is characteristic of the object's spectral reflectance. In this paper, we use this property in order to estimate the spectral reflectance of matte, uniformly colored, V-shaped surfaces from a single RGB image taken under directional lighting. First, simulations show that using one image of the concave object is equivalent to, and can even outperform, the state-of-the-art approaches based on three images taken under three lightings with different colors. Experiments on real images of folded papers were performed under unmeasured direct sunlight. The results show that our interreflection-based approach outperforms existing approaches, even when the latter are improved by a calibration step. The mathematical solution for the interreflection equation and the effect of surface parameters on the performance of the method are also discussed in this paper.