Visual saliency guided perceptual adaptive quantization based on HEVC intra-coding for planetary images

PLoS One. 2022 Feb 9;17(2):e0263729. doi: 10.1371/journal.pone.0263729. eCollection 2022.

Abstract

Due to the limited storage space of spacecraft and downlink bandwidth in the data delivery during planetary exploration, an efficient way for image compression onboard is essential to reduce the volume of acquired data. Applicable for planetary images, this study proposes a perceptual adaptive quantization technique based on Convolutional Neural Network (CNN) and High Efficiency Video Coding (HEVC). This technique is used for bitrate reduction while maintaining the subjective visual quality. The proposed algorithm adaptively determines the Coding Tree Unit (CTU) level Quantization Parameter (QP) values in HEVC intra-coding using the high-level features extracted by CNN. A modified model based on the residual network is exploited to extract the saliency map for a given image automatically. Furthermore, based on the saliency map, a CTU level QP adjustment technique combining global saliency contrast and local saliency perception is exploited to realize a flexible and adaptive bit allocation. Several quantitative performance metrics that efficiently correlate with human perception are used for evaluating image quality. The experimental results reveal that the proposed algorithm achieves better visual quality along with a maximum of 7.17% reduction in the bitrate as compared to the standard HEVC coding.

MeSH terms

  • Algorithms
  • Data Compression / methods*
  • Humans
  • Limit of Detection
  • Neural Networks, Computer
  • Planets
  • Satellite Imagery* / methods
  • Satellite Imagery* / standards
  • Spacecraft
  • Video Recording / methods
  • Video Recording / standards
  • Visual Perception / physiology*

Grants and funding

The author(s) received no specific funding for this work.