Compression for Bayer CFA Images: Review and Performance Comparison

Sensors (Basel). 2022 Oct 31;22(21):8362. doi: 10.3390/s22218362.

Abstract

Bayer color filter array (CFA) images are captured by a single-chip image sensor covered with a Bayer CFA pattern which has been widely used in modern digital cameras. In the past two decades, many compression methods have been proposed to compress Bayer CFA images. These compression methods can be roughly divided into the compression-first-based (CF-based) scheme and the demosaicing-first-based (DF-based) scheme. However, in the literature, no review article for the two compression schemes and their compression performance is reported. In this article, the related CF-based and DF-based compression works are reviewed first. Then, the testing Bayer CFA images created from the Kodak, IMAX, screen content images, videos, and classical image datasets are compressed on the Joint Photographic Experts Group-2000 (JPEG-2000) and the newly released Versatile Video Coding (VVC) platform VTM-16.2. In terms of the commonly used objective quality, perceptual quality metrics, the perceptual effect, and the quality-bitrate tradeoff metric, the compression performance comparison of the CF-based compression methods, in particular the reversible color transform-based compression methods and the DF-based compression methods, is reported and discussed.

Keywords: Bayer color filter array (CFA) images; Versatile Video Coding (VVC); chroma subsampling-then-luma modification; compression-first-based compression; demosaicing-first-based compression; joint photographic experts group-2000 (JPEG-2000); quality–bitrate tradeoff; reversible color transform-based compression.

Publication types

  • Review

Grants and funding

This work was supported by the contracts MOST-110-2221-E-011-088-MY3 and MOST-108-2221-E-011-077-MY3 of the Ministry of Science and Technology, Taiwan.