Stereo super-resolution images detection based on multi-scale feature extraction and hierarchical feature fusion

Abstract

Recently, with most mobile phones coming with dual cameras, stereo image super-resolution is becoming increasingly popular in phones and other modern acquisition devices, leading stereo super-resolution images spread widely on the Internet. However, current image forensics methods are carried out in monocular images, and high false positive rate appears when detecting stereo super-resolution images by these methods. Therefore, it is important to develop stereo super-resolution image detection method. In this paper, a convolutional neural network with multi-scale feature extraction and hierarchical feature fusion is proposed to detect the stereo super-resolution images. Multi-atrous convolutions are employed to extract multi-scale features and be adapt for varying stereo super-resolution images, and hierarchical feature fusion further improve the performance and robustness of the model. Experimental results demonstrate that the proposed network can detect stereo super-resolution images effectively and achieve strong generalization and robustness. To the best of our knowledge, it is the first attempt to investigate the performance of current forensics methods when tested under stereo super-resolution images, and represent the first study of stereo super-resolution images detection. We believe that it can raise the awareness about the security of stereo super-resolution images.

Keywords: Hierarchical feature fusion; Multi-atrous convolution; Multi-scale feature extraction; Stereo super-resolution images detection.