Static Hand Gesture Recognition Using Capacitive Sensing and Machine Learning

Sensors (Basel). 2023 Mar 24;23(7):3419. doi: 10.3390/s23073419.

Abstract

Automated hand gesture recognition is a key enabler of Human-to-Machine Interfaces (HMIs) and smart living. This paper reports the development and testing of a static hand gesture recognition system using capacitive sensing. Our system consists of a 6×18 array of capacitive sensors that captured five gestures-Palm, Fist, Middle, OK, and Index-of five participants to create a dataset of gesture images. The dataset was used to train Decision Tree, Naïve Bayes, Multi-Layer Perceptron (MLP) neural network, and Convolutional Neural Network (CNN) classifiers. Each classifier was trained five times; each time, the classifier was trained using four different participants' gestures and tested with one different participant's gestures. The MLP classifier performed the best, achieving an average accuracy of 96.87% and an average F1 score of 92.16%. This demonstrates that the proposed system can accurately recognize hand gestures and that capacitive sensing is a viable method for implementing a non-contact, static hand gesture recognition system.

Keywords: Human-to-Machine Interface; capacitive sensing; hand gesture recognition; machine learning.

MeSH terms

  • Algorithms
  • Bayes Theorem
  • Gestures*
  • Hand
  • Humans
  • Machine Learning
  • Neural Networks, Computer
  • Pattern Recognition, Automated* / methods

Grants and funding

This research received no external funding.