A Novel EMG-Based Hand Gesture Recognition Framework Based on Multivariate Variational Mode Decomposition

Sensors (Basel). 2021 Oct 22;21(21):7002. doi: 10.3390/s21217002.

Abstract

Surface electromyography (sEMG) is a kind of biological signal that records muscle activity noninvasively, which is of great significance in advanced human-computer interaction, prosthetic control, clinical therapy, and biomechanics. However, the number of hand gestures that can be recognized is limited and the recognition accuracy needs to be further improved. These factors lead to the fact that sEMG products are not widely used in practice. The main contributions of this paper are as follows. Firstly, considering the increasing number of gestures to be recognized and the complexity of gestures, an extensible two-stage machine learning lightweight framework was innovatively proposed for multi-gesture task recognition. Secondly, the multivariate variational mode decomposition (MVMD) is applied to extract the spatial-temporal features from the multiple channels to the EMG signals, and the separable convolutional neural network is used for modelling. In this work, the experimental results for 52 hand gestures recognition task show that the average accuracy on each stage is about 90%. The potential movement information is mainly contained in the low-frequency oscillator of the sEMG signal, and the model performs better with the low-frequency oscillation from the MVMD algorithm on the second stage classification than that of other decomposition methods.

Keywords: MVMD; hand gesture recognition; sEMG; separable convolution neural network; two-stage framework.

MeSH terms

  • Algorithms
  • Electromyography
  • Gestures*
  • Hand
  • Humans
  • Neural Networks, Computer
  • Signal Processing, Computer-Assisted*