Deep learning-based pigment analysis model trained with optical approach and ground truth assistance

Abstract

This study introduces an integrated training method combining the optical approach with ground truth for skin pigment analysis. Deep learning is increasingly applied to skin pigment analysis, primarily melanin and hemoglobin. While regression analysis is a widely used training method to predict ground truth-like outputs, the input image resolution is restricted by computational resources. The optical approach-based regression method can alleviate this problem, but compromises performance. We propose a strategy to overcome the limitation of image resolution while preserving performance by incorporating ground truth within the optical approach-based learning structure. The proposed model decomposes skin images into melanin, hemoglobin, and shading maps, reconstructing them by solving the forward problem with reference to the ground truth for pigments. Evaluation against the VISIA system, a professional diagnostic equipment, yields correlation coefficients of 0.978 for melanin and 0.975 for hemoglobin. Furthermore, our model can produce pigment-modified images for applications like simulating treatment effects.

Keywords: deep learning; diffuse Optics; skin analysis; skin pigment.