Neural network model assisted Fourier ptychography with Zernike aberration recovery and total variation constraint

J Biomed Opt. 2021 Mar;26(3):036502. doi: 10.1117/1.JBO.26.3.036502.

Abstract

Significance: Fourier ptychography (FP) is a computational imaging approach that achieves high-resolution reconstruction. Inspired by neural networks, many deep-learning-based methods are proposed to solve FP problems. However, the performance of FP still suffers from optical aberration, which needs to be considered.

Aim: We present a neural network model for FP reconstructions that can make proper estimation toward aberration and achieve artifact-free reconstruction.

Approach: Inspired by the iterative reconstruction of FP, we design a neural network model that mimics the forward imaging process of FP via TensorFlow. The sample and aberration are considered as learnable weights and optimized through back-propagation. Especially, we employ the Zernike terms instead of aberration to decrease the optimization freedom of pupil recovery and perform a high-accuracy estimation. Owing to the auto-differentiation capabilities of the neural network, we additionally utilize total variation regularization to improve the visual quality.

Results: We validate the performance of the reported method via both simulation and experiment. Our method exhibits higher robustness against sophisticated optical aberrations and achieves better image quality by reducing artifacts.

Conclusions: The forward neural network model can jointly recover the high-resolution sample and optical aberration in iterative FP reconstruction. We hope our method that can provide a neural-network perspective to solve iterative-based coherent or incoherent imaging problems.

Keywords: Fourier ptychographic microscopy; neural network; optics; pupil recovery.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Artifacts
  • Image Processing, Computer-Assisted*
  • Neural Networks, Computer*
  • Pupil
  • Tomography, X-Ray Computed