In-air Hand Gesture Signature Recognition: An iHGS Database Acquisition Protocol

F1000Res. 2023 May 2:11:283. doi: 10.12688/f1000research.74134.2. eCollection 2022.

Abstract

Background: With the advances in current technology, hand gesture recognition has gained considerable attention. It has been extended to recognize more distinctive movements, such as a signature, in human-computer interaction (HCI) which enables the computer to identify a person in a non-contact acquisition environment. This application is known as in-air hand gesture signature recognition. To our knowledge, there are no publicly accessible databases and no detailed descriptions of the acquisitional protocol in this domain. Methods: This paper aims to demonstrate the procedure for collecting the in-air hand gesture signature's database. This database is disseminated as a reference database in the relevant field for evaluation purposes. The database is constructed from the signatures of 100 volunteer participants, who contributed their signatures in two different sessions. Each session provided 10 genuine samples enrolled using a Microsoft Kinect sensor camera to generate a genuine dataset. In addition, a forgery dataset was also collected by imitating the genuine samples. For evaluation, each sample was preprocessed with hand localization and predictive hand segmentation algorithms to extract the hand region. Then, several vector-based features were extracted. Results: In this work, classification performance analysis and system robustness analysis were carried out. In the classification analysis, a multiclass Support Vector Machine (SVM) was employed to classify the samples and 97.43% accuracy was achieved; while the system robustness analysis demonstrated low error rates of 2.41% and 5.07% in random forgery and skilled forgery attacks, respectively. Conclusions: These findings indicate that hand gesture signature is not only feasible for human classification, but its properties are also robust against forgery attacks.

Keywords: Dynamic Signature; Forgeries Attack; Gesture Recognition; Hand Gesture Signature; Hand Gesture Signature Database; Image Processing.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms*
  • Databases, Factual
  • Gestures*
  • Humans
  • Knowledge
  • Movement

Associated data

  • figshare/10.6084/m9.figshare.16643314

Grants and funding

This work was funded to W. H. by the Multimedia University internal MiniFund under grant No. MMUI/150074. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.