High-Speed Video System for Micro-Expression Detection and Recognition

Sensors (Basel). 2017 Dec 14;17(12):2913. doi: 10.3390/s17122913.

Abstract

Micro-expressions play an essential part in understanding non-verbal communication and deceit detection. They are involuntary, brief facial movements that are shown when a person is trying to conceal something. Automatic analysis of micro-expression is challenging due to their low amplitude and to their short duration (they occur as fast as 1/15 to 1/25 of a second). We propose a fully micro-expression analysis system consisting of a high-speed image acquisition setup and a software framework which can detect the frames when the micro-expressions occurred as well as determine the type of the emerged expression. The detection and classification methods use fast and simple motion descriptors based on absolute image differences. The recognition module it only involves the computation of several 2D Gaussian probabilities. The software framework was tested on two publicly available high speed micro-expression databases and the whole system was used to acquire new data. The experiments we performed show that our solution outperforms state of the art works which use more complex and computationally intensive descriptors.

Keywords: affective computing; difference images; facial expression recognition; micro-expression recognition; micro-expression spotting.

MeSH terms

  • Algorithms
  • Databases, Factual
  • Facial Expression
  • Humans
  • Motion
  • Normal Distribution
  • Pattern Recognition, Automated
  • Software
  • Time Factors
  • Video Recording*