Intrinsic RGB and multispectral images recovery by independent quadratic programming

PeerJ Comput Sci. 2020 Feb 10:6:e256. doi: 10.7717/peerj-cs.256. eCollection 2020.

Abstract

This work introduces a method to estimate reflectance, shading, and specularity from a single image. Reflectance, shading, and specularity are intrinsic images derived from the dichromatic model. Estimation of these intrinsic images has many applications in computer vision such as shape recovery, specularity removal, segmentation, or classification. The proposed method allows for recovering the dichromatic model parameters thanks to two independent quadratic programming steps. Compared to the state of the art in this domain, our approach has the advantage to address a complex inverse problem into two parallelizable optimization steps that are easy to solve and do not require learning. The proposed method is an extension of a previous algorithm that is rewritten to be numerically more stable, has better quantitative and qualitative results, and applies to multispectral images. The proposed method is assessed qualitatively and quantitatively on standard RGB and multispectral datasets.

Keywords: Color and multispectral image processing; Dichromatic model; Intrinsic images decomposition; Quadratic Programming.

Grants and funding

This study was supported by the French Research National Agency (ANR) program EMMIE under the grant agreement 15-CE17-0015. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.