Boundary-Preserved Deep Denoising of Stochastic Resonance Enhanced Multiphoton Images

IEEE J Transl Eng Health Med. 2022 Sep 14:10:1800812. doi: 10.1109/JTEHM.2022.3206488. eCollection 2022.

Abstract

Objective: With the rapid growth of high-speed deep-tissue imaging in biomedical research, there is an urgent need to develop a robust and effective denoising method to retain morphological features for further texture analysis and segmentation. Conventional denoising filters and models can easily suppress the perturbative noise in high-contrast images; however, for low photon budget multiphoton images, a high detector gain will not only boost the signals but also bring significant background noise. In such a stochastic resonance imaging regime, subthreshold signals may be detectable with the help of noise, meaning that a denoising filter capable of removing noise without sacrificing important cellular features, such as cell boundaries, is desirable.

Method: We propose a convolutional neural network-based denoising autoencoder method - a fully convolutional deep denoising autoencoder (DDAE) - to improve the quality of three-photon fluorescence (3PF) and third-harmonic generation (THG) microscopy images.

Results: The average of 200 acquired images of a given location served as the low-noise answer for the DDAE training. Compared with other conventional denoising methods, our DDAE model shows a better signal-to-noise ratio (28.86 and 21.66 for 3PF and THG, respectively), structural similarity (0.89 and 0.70 for 3PF and THG, respectively), and preservation of the nuclear or cellular boundaries (F1-score of 0.662 and 0.736 for 3PF and THG, respectively). It shows that DDAE is a better trade-off approach between structural similarity and preserving signal regions.

Conclusions: The results of this study validate the effectiveness of the DDAE system in boundary-preserved image denoising.

Clinical impact: The proposed deep denoising system can enhance the quality of microscopic images and effectively support clinical evaluation and assessment.

Keywords: Third harmonic generation; deep denoising autoencoder; three-photon fluorescence.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Neural Networks, Computer*
  • Noise*
  • Signal-To-Noise Ratio

Grants and funding

This work was supported in part by the Faculty of Health Sciences, University of Macau, the startup Grants of the University of Macau; in part by the Science and Technology Development Fund, Macau SAR, under Grant 122/2016/A3, Grant 018/2017/A1, Grant 0011/2019/AKP, Grant 0120/2020/A3, and Grant 0026/2021/A; in part by the Cardiovascular Center, Division of Cardiology, Department of Internal Medicine, National Taiwan University Hospital, Ministry of Science and Technology, R.O.C., under Grant MOST 107-2314-B-002-262-MY2; and in part by the Academia Sinica under Grant AS-GC-111-M01.