Robust underwater image enhancement with cascaded multi-level sub-networks and triple attention mechanism

Neural Netw. 2024 Jan:169:685-697. doi: 10.1016/j.neunet.2023.11.008. Epub 2023 Nov 10.

Abstract

With the growing exploration of marine resources, underwater image enhancement has gained significant attention. Recent advances in convolutional neural networks (CNN) have greatly impacted underwater image enhancement techniques. However, conventional CNN-based methods typically employ a single network structure, which may compromise robustness in challenging conditions. Additionally, commonly used UNet networks generally force fusion from low to high resolution for each layer, leading to inaccurate contextual information encoding. To address these issues, we propose a novel network called Cascaded Network with Multi-level Sub-networks (CNMS), which encompasses the following key components: (a) a cascade mechanism based on local modules and global networks for extracting feature representations with richer semantics and enhanced spatial precision, (b) information exchange between different resolution streams, and (c) a triple attention module for extracting attention-based features. CNMS selectively cascades multiple sub-networks through triple attention modules to extract distinct features from underwater images, bolstering the network's robustness and improving generalization capabilities. Within the sub-network, we introduce a Multi-level Sub-network (MSN) that spans multiple resolution streams, combining contextual information from various scales while preserving the original underwater images' high-resolution spatial details. Comprehensive experiments on multiple underwater datasets demonstrate that CNMS outperforms state-of-the-art methods in image enhancement tasks.

Keywords: Cascading mechanism; Deep convolutional network; Multi-scale feature representation; Underwater image enhancement.

MeSH terms

  • Generalization, Psychological*
  • Image Enhancement*
  • Image Processing, Computer-Assisted
  • Neural Networks, Computer
  • Semantics