Deep learning enhancement of infrared face images using generative adversarial networks

Appl Opt. 2018 Jun 20;57(18):D98-D107. doi: 10.1364/AO.57.000D98.

Abstract

This work presents a deep learning framework based on the use of deep convolutional generative adversarial networks (DCGAN) for infrared face image super-resolution. We use DCGAN for upscaling the images by a factor of 4×4, starting at a size of 16×16 and obtaining a 64×64 face image. Tests are conducted using different infrared face datasets operating in the near-infrared (NIR) and the long-wave infrared (LWIR) spectrum. We can see that the proposed framework performs well and preserves important details of the face. This kind of approach can be very useful in security applications where we can scan faces in the crowd or detect faces at a distance and upscale them for further recognition through an infrared or a multispectral face recognition system.

MeSH terms

  • Algorithms
  • Databases as Topic
  • Face / anatomy & histology*
  • Female
  • Humans
  • Image Processing, Computer-Assisted*
  • Infrared Rays*
  • Machine Learning*
  • Male
  • Neural Networks, Computer*
  • Signal-To-Noise Ratio