Saliency Detection of Light Field Images by Fusing Focus Degree and GrabCut

Fuzhou Duan; Yanyan Wu; Hongliang Guan; Chenbo Wu

doi:10.3390/s22197411

Saliency Detection of Light Field Images by Fusing Focus Degree and GrabCut

Sensors (Basel). 2022 Sep 29;22(19):7411. doi: 10.3390/s22197411.

Authors

Fuzhou Duan^{1

2}, Yanyan Wu^{1

2}, Hongliang Guan^{1

2

3}, Chenbo Wu^{1

2}

Affiliations

¹ Engineering Research Center of Spatial Information Technology, MOE, Capital Normal University, 105 West Third Ring North Road, Haidian District, Beijing 100048, China.
² Key Lab of 3D Information Acquisition and Application, MOE, Capital Normal University, 105 West Third Ring North Road, Haidian District, Beijing 100048, China.
³ Academy for Multidisciplinary Studies, Capital Normal University, 105 West Third Ring North Road, Haidian District, Beijing 100048, China.

Abstract

In the light field image saliency detection task, redundant cues are introduced due to computational methods. Inevitably, it leads to the inaccurate boundary segmentation of detection results and the problem of the chain block effect. To tackle this issue, we propose a method for salient object detection (SOD) in light field images that fuses focus and GrabCut. The method improves the light field focus calculation based on the spatial domain by performing secondary blurring processing on the focus image and effectively suppresses the focus information of out-of-focus areas in different focus images. Aiming at the redundancy of focus cues generated by multiple foreground images, we use the optimal single foreground image to generate focus cues. In addition, aiming at the fusion of various cues in the light field in complex scenes, the GrabCut algorithm is combined with the focus cue to guide the generation of color cues, which realizes the automatic saliency target segmentation of the image foreground. Extensive experiments are conducted on the light field dataset to demonstrate that our algorithm can effectively segment the salient target area and background area under the light field image, and the outline of the salient object is clear. Compared with the traditional GrabCut algorithm, the focus degree is used instead of artificial Interactively initialize GrabCut to achieve automatic saliency segmentation.

Keywords: GrabCut; foreground matting; light field; salient object detection.

MeSH terms

Algorithms*
Cues*

Grants and funding

This work was supported by the National Key R&D Program of China (No. 2018YFC1800904); Capacity Building for Sci-Tech Innovation—Fundamental Scientific Research Funds (No. 20530290078).