End-to-end residual attention mechanism for cataractous retinal image dehazing

Comput Methods Programs Biomed. 2022 Jun:219:106779. doi: 10.1016/j.cmpb.2022.106779. Epub 2022 Mar 27.

Abstract

Background and objective: Cataract is one of the most common causes of vision loss. Light scattering due to clouding of the lens in cataract patients makes it extremely difficult to image the retina of cataract patients with fundus cameras, resulting in a serious decrease in the quality of the retinal images taken. Furthermore, the age of cataract patients is generally too old, in addition to cataracts, the patients often have other retinal diseases, which brings great challenges to experts in the clinical diagnosis of cataract patients using retinal imaging.

Methods: In this paper, we present the End-to-End Residual Attention Mechanism (ERAN) for Cataractous Retinal Image Dehazing, which it includes four modules: encoding module, multi-scale feature extraction module, feature fusion module, and decoding module. The encoding module encodes the input cataract haze image into an image, facilitating subsequent feature extraction and reducing memory usage. The multi-scale feature extraction module includes a hole convolution module, a residual block, and an adaptive skip connection, which can expand the receptive field and extract features of different scales through weighted screening for fusion. The feature fusion module uses adaptive skip connections to enhance the network's ability to extract haze density images to make haze removal more thorough. Furthermore, the decoding module performs non-linear mapping on the fused features to obtain the haze density image, and then restores the haze-free image.

Results: The experimental results show that the proposed method has achieved better objective and subjective evaluation results, and has a better dehazing effect.

Conclusion: We proposed ERAN method not only provides visually better images, but also helps experts better diagnose other retinal diseases in cataract patients, leading to better care and treatment.

Keywords: Cataractous; Dehaze; Residual attention mechanism; Retinal image; Skip connection.

MeSH terms

  • Cataract* / diagnostic imaging
  • Disease Progression
  • Humans
  • Image Processing, Computer-Assisted / methods
  • Neural Networks, Computer
  • Retina / diagnostic imaging
  • Retinal Diseases*