Physics-based learning with channel attention for Fourier ptychographic microscopy

J Biophotonics. 2022 Mar;15(3):e202100296. doi: 10.1002/jbio.202100296. Epub 2021 Nov 28.

Abstract

Fourier ptychographic microscopy (FPM) is a computational imaging technology for large field-of-view, high resolution and quantitative phase imaging. In FPM, low-resolution intensity images captured with angle-varying illumination are synthesized in Fourier space with phase retrieval approaches. However, system errors such as pupil aberration and light-emitting diode (LED) intensity error seriously affect the reconstruction performance. In this article, we propose a physics-based neural network with channel attention for FPM reconstruction. With the channel attention module, which is introduced into physics-based neural networks for the first time, the spatial distribution of LED intensity can be adaptively corrected. Besides, the channel attention module is used to synthesize different Zernike modes and recover the pupil function. Detailed simulations and experiments are carried out to validate the effectiveness and robustness of the proposed method. The results demonstrate that our method achieves better performance in high-resolution complex field reconstruction, LED intensity correction and pupil function recovery compared with the state-of-art methods. The combination with deep neural network structures like channel attention modules significantly enhance the performance of physics-based neural networks and will promote the application of FPM in practical use.

Keywords: Fourier ptychographic microscopy; LED intensity correction; channel attention; physics-based learning; pupil aberration correction.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Attention
  • Fourier Analysis
  • Lighting
  • Microscopy* / methods
  • Neural Networks, Computer*