MTIE-Net: Multi-technology fusion of low-light image enhancement network

PLoS One. 2024 Feb 2;19(2):e0297984. doi: 10.1371/journal.pone.0297984. eCollection 2024.

Abstract

Images obtained in low-light scenes are often accompanied by problems such as low visibility, blurred details, and color distortion, enhancing them can effectively improve the visual effect and provide favorable conditions for advanced visual tasks. In this study, we propose a Multi-Technology Fusion of Low-light Image Enhancement Network (MTIE-Net) that modularizes the enhancement task. MTIE-Net consists of a residual dense decomposition network (RDD-Net) based on Retinex theory, an encoder-decoder denoising network (EDD-Net), and a parallel mixed attention-based self-calibrated illumination enhancement network (PCE-Net). The low-light image is first decomposed by RDD-Net into a lighting map and reflectance map; EDD-Net is used to process noise in the reflectance map; Finally, the lighting map is fused with the denoised reflectance map as an input to PCE-Net, using the Fourier transform for illumination enhancement and detail recovery in the frequency domain. Numerous experimental results show that MTIE-Net outperforms the comparison methods in terms of image visual quality enhancement improvement, denoising, and detail recovery. The application in nighttime face detection also fully demonstrates its promise as a pre-processing means in practical applications.

MeSH terms

  • Image Enhancement*
  • Image Processing, Computer-Assisted
  • Lighting
  • Refractive Surgical Procedures*
  • Technology

Grants and funding

This research was funded by The Project of Sichuan provincial science and Technology Department (Grant No. 2022YFS0518, 2022ZHCG0035); The artificial intelligence key laboratory of Sichuan province Foundation (2023RYY06); Enterprise informatization and Internet of things measurement and control technology key laboratory project of Sichuan provincial university (2022WYY04); Talent Introduction Project of Sichuan University of Science and Engineering(2021RC12). The artificial intelligence key laboratory of Sichuan province Foundation (2019RYY01);H.W The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Talent Introduction Project of Sichuan University of Science and Engineering (2021RC12);H.W The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.