A Novel Domain Transfer-Based Approach for Unsupervised Thermal Image Super-Resolution

Sensors (Basel). 2022 Mar 14;22(6):2254. doi: 10.3390/s22062254.

Abstract

This paper presents a transfer domain strategy to tackle the limitations of low-resolution thermal sensors and generate higher-resolution images of reasonable quality. The proposed technique employs a CycleGAN architecture and uses a ResNet as an encoder in the generator along with an attention module and a novel loss function. The network is trained on a multi-resolution thermal image dataset acquired with three different thermal sensors. Results report better performance benchmarking results on the 2nd CVPR-PBVS-2021 thermal image super-resolution challenge than state-of-the-art methods. The code of this work is available online.

Keywords: attention module; semiregistered thermal images; thermal image super-resolution; thermal images; unsupervised super-resolution.

MeSH terms

  • Algorithms*
  • Image Processing, Computer-Assisted* / methods
  • Magnetic Resonance Imaging / methods