Multi-Stroke handwriting character recognition based on sEMG using convolutional-recurrent neural networks

Math Biosci Eng. 2020 Aug 12;17(5):5432-5448. doi: 10.3934/mbe.2020293.

Abstract

Despite the increasing use of technology, handwriting has remained to date as an efficient means of communication. Certainly, handwriting is a critical motor skill for childrens cognitive development and academic success. This article presents a new methodology based on electromyographic signals to recognize multi-user free-style multi-stroke handwriting characters. The approach proposes using powerful Deep Learning (DL) architectures for feature extraction and sequence recognition, such as convolutional and recurrent neural networks. This framework was thoroughly evaluated, obtaining an accuracy of 94.85%. The development of handwriting devices can be potentially applied in the creation of artificial intelligence applications to enhance communication and assist people with disabilities.

Keywords: convolutional neural networks; gated recurrent unit; long short-term memory; surface EMG.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Artificial Intelligence*
  • Child
  • Handwriting
  • Humans
  • Neural Networks, Computer
  • Stroke*