Multi-Criterion Sampling Matting Algorithm via Gaussian Process

Biomimetics (Basel). 2023 Jul 10;8(3):301. doi: 10.3390/biomimetics8030301.

Abstract

Natural image matting is an essential technique for image processing that enables various applications, such as image synthesis, video editing, and target tracking. However, the existing image matting methods may fail to produce satisfactory results when computing resources are limited. Sampling-based methods can reduce the dimensionality of the decision space and, therefore, reduce computational resources by employing different sampling strategies. While these approaches reduce computational consumption, they may miss an optimal pixel pair when the number of available high-quality pixel pairs is limited. To address this shortcoming, we propose a novel multi-criterion sampling strategy that avoids missing high-quality pixel pairs by incorporating multi-range pixel pair sampling and a high-quality sample selection method. This strategy is employed to develop a multi-criterion matting algorithm via Gaussian process, which searches for the optimal pixel pair by using the Gaussian process fitting model instead of solving the original pixel pair objective function. The experimental results demonstrate that our proposed algorithm outperformed other methods, even with 1% computing resources, and achieved alpha matte results comparable to those yielded by the state-of-the-art optimization algorithms.

Keywords: Gaussian process fitting model; alpha matte; computing resources; high-quality pixel pairs; multi-criterion sampling strategy.

Grants and funding

This work was funded by [the National Natural Science Foundation of China] grant number [62276103, 62002053, 61906069], [the Guizhou Provincial Science and Technology Projects] grant number [QKHJCZK2022YB195, QKHJCZK2023YB143, QKH-Platform Talent-ZCKJ [2021]007], [the Natural Science Foundation of Guangdong Province] grant number [2020A1515010696, 2022A1515011491, 2021A0101180005], [the Fundamental Research Funds for the Central Universities] grant number [2020ZYGXZR014], and The APC was funded by [the Youth Science and Technology Talents Cultivating Object of Guizhou Province] grant number [QJHKY2021104, QJHKY [2021]111], [the Science and Technology Support Program of Guizhou Province] grant number [QKHZC2021YB531], [the Natural Science Research Project of Department of Education of Guizhou Province] grant number [QJJ2023012, QJJ2023061, QJJ2023062], [the Zhongshan Science and Technology Research Project of Social welfare] grant number [2020B2017, 210714094038458] and [the high-level personnel Scientific Research Foundation Project of Zhongshan] grant number [2019A4018].