Facial expression recognition using lightweight deep learning modeling

Math Biosci Eng. 2023 Feb 27;20(5):8208-8225. doi: 10.3934/mbe.2023357.

Abstract

Facial expression is a type of communication and is useful in many areas of computer vision, including intelligent visual surveillance, human-robot interaction and human behavior analysis. A deep learning approach is presented to classify happy, sad, angry, fearful, contemptuous, surprised and disgusted expressions. Accurate detection and classification of human facial expression is a critical task in image processing due to the inconsistencies amid the complexity, including change in illumination, occlusion, noise and the over-fitting problem. A stacked sparse auto-encoder for facial expression recognition (SSAE-FER) is used for unsupervised pre-training and supervised fine-tuning. SSAE-FER automatically extracts features from input images, and the softmax classifier is used to classify the expressions. Our method achieved an accuracy of 92.50% on the JAFFE dataset and 99.30% on the CK+ dataset. SSAE-FER performs well compared to the other comparative methods in the same domain.

Keywords: classification; deep learning; facial expression recognition; machine learning; stacked sparse auto-encoder.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Communication
  • Deep Learning*
  • Facial Recognition*
  • Fear
  • Humans
  • Image Processing, Computer-Assisted