Efficient spatio-temporal local binary patterns for spontaneous facial micro-expression recognition

PLoS One. 2015 May 19;10(5):e0124674. doi: 10.1371/journal.pone.0124674. eCollection 2015.

Abstract

Micro-expression recognition is still in the preliminary stage, owing much to the numerous difficulties faced in the development of datasets. Since micro-expression is an important affective clue for clinical diagnosis and deceit analysis, much effort has gone into the creation of these datasets for research purposes. There are currently two publicly available spontaneous micro-expression datasets--SMIC and CASME II, both with baseline results released using the widely used dynamic texture descriptor LBP-TOP for feature extraction. Although LBP-TOP is popular and widely used, it is still not compact enough. In this paper, we draw further inspiration from the concept of LBP-TOP that considers three orthogonal planes by proposing two efficient approaches for feature extraction. The compact robust form described by the proposed LBP-Six Intersection Points (SIP) and a super-compact LBP-Three Mean Orthogonal Planes (MOP) not only preserves the essential patterns, but also reduces the redundancy that affects the discriminality of the encoded features. Through a comprehensive set of experiments, we demonstrate the strengths of our approaches in terms of recognition accuracy and efficiency.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Facial Expression*
  • Facial Recognition*
  • Humans

Grants and funding

The funding of this work is only from the TM Grant under project UbeAware. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.