Pentagraph image fusion scheme for motion blur prevention using multiple monochromatic images

Appl Opt. 2016 Apr 10;55(11):3096-103. doi: 10.1364/AO.55.003096.

Abstract

This paper introduces the pentagraph image fusion (PIF) scheme for motion-related blur prevention in images. The PIF algorithm processes five monochromatic images into a single, low-noise, no-blur color image. The images are acquired using a new photography scheme, sequential filter photography (SFP), where instead of using a stationary Bayer pattern color filter array in front of the image sensor, a tunable color filter array is used. Using this approach, several monochromatic images are captured one by one and later fused into one color image. The SFP introduces various advantages such as higher resolution, better SNR, and the ability to control both exposure time and color filter separately for each image. The PIF algorithm harnesses all the advantages of SFP for the first time, to the best of our knowledge, in the field of blur-free image acquisition. Five images are taken with controllable exposure time and color filter, three images for the color bands, and two high-signal panchromatic images. These images are fused together to be a single, low-noise, no-blur color image. The algorithm presents a generic approach of dealing with both local and global motion blur and does not require any user intervention.