Face and Body-Based Human Recognition by GAN-Based Blur Restoration

Sensors (Basel). 2020 Sep 14;20(18):5229. doi: 10.3390/s20185229.

Abstract

The long-distance recognition methods in indoor environments are commonly divided into two categories, namely face recognition and face and body recognition. Cameras are typically installed on ceilings for face recognition. Hence, it is difficult to obtain a front image of an individual. Therefore, in many studies, the face and body information of an individual are combined. However, the distance between the camera and an individual is closer in indoor environments than that in outdoor environments. Therefore, face information is distorted due to motion blur. Several studies have examined deblurring of face images. However, there is a paucity of studies on deblurring of body images. To tackle the blur problem, a recognition method is proposed wherein the blur of body and face images is restored using a generative adversarial network (GAN), and the features of face and body obtained using a deep convolutional neural network (CNN) are used to fuse the matching score. The database developed by us, Dongguk face and body dataset version 2 (DFB-DB2) and ChokePoint dataset, which is an open dataset, were used in this study. The equal error rate (EER) of human recognition in DFB-DB2 and ChokePoint dataset was 7.694% and 5.069%, respectively. The proposed method exhibited better results than the state-of-art methods.

Keywords: CNN; DeblurGAN; blur image restoration; multimodal human recognition.

MeSH terms

  • Automated Facial Recognition*
  • Biometric Identification / instrumentation*
  • Databases, Factual
  • Face*
  • Humans
  • Image Processing, Computer-Assisted*
  • Motion
  • Neural Networks, Computer*