Generalizable Polyp Segmentation via Randomized Global Illumination Augmentation

IEEE J Biomed Health Inform. 2024 Feb 20:PP. doi: 10.1109/JBHI.2024.3363910. Online ahead of print.

Abstract

Accurately segmenting polyps from colonoscopy images is essential for diagnosing colorectal cancer. Despite the tremendous success of the deep convolutional neural networks in automatic polyp segmentation, it suffers from domain shift issues, where the trained model yields performance deterioration on unseen test datasets. This paper proposes an illumination enhancement-based domain generalization approach to improve the generalization capability of the model on unseen test datasets and alleviate this issue. In particular, an image decomposition module (IDM) was developed to separate colonoscopy images into reflectance, local, and global illumination components. An illumination transform module (ITM) was proposed to augment images with different global illuminations by synthesizing target-like global illumination maps. A novel illumination variance insensitiveness (IViSen) is also introduced to evaluate the robustness of the model against illumination disturbance. IViSen is easy to compute and correlates well with model generalizability. The segmentation performance of the proposed model on four colonoscopy datasets was examined: CVC-ClinicDB, CVC-ColonDB, ETIS-Larib, and Kvasir-SEG. The method outperformed the competitive methods when tested on unseen domains. In particular, the proposed approach yielded 60.82% and 53.19% in terms of mean Dice and IoU, respectively, with 2.06% and 2.31% improvements.