A Fast Preprocessing Method for Micro-Expression Spotting via Perceptual Detection of Frozen Frames

J Imaging. 2021 Apr 2;7(4):68. doi: 10.3390/jimaging7040068.

Abstract

This paper presents a preliminary study concerning a fast preprocessing method for facial microexpression (ME) spotting in video sequences. The rationale is to detect frames containing frozen expressions as a quick warning for the presence of MEs. In fact, those frames can either precede or follow (or both) MEs according to ME type and the subject's reaction. To that end, inspired by the Adelson-Bergen motion energy model and the instinctive nature of the preattentive vision, global visual perception-based features were employed for the detection of frozen frames. Preliminary results achieved on both controlled and uncontrolled videos confirmed that the proposed method is able to correctly detect frozen frames and those revealing the presence of nearby MEs-independently of ME kind and facial region. This property can then contribute to speeding up and simplifying the ME spotting process, especially during long video acquisitions.

Keywords: facial microexpressions; motion energy; preattentive vision; spatio-temporal filtering; standard deviation.