Tactile Avatar: Tactile Sensing System Mimicking Human Tactile Cognition

Adv Sci (Weinh). 2021 Feb 8;8(7):2002362. doi: 10.1002/advs.202002362. eCollection 2021 Apr.

Abstract

As a surrogate for human tactile cognition, an artificial tactile perception and cognition system are proposed to produce smooth/soft and rough tactile sensations by its user's tactile feeling; and named this system as "tactile avatar". A piezoelectric tactile sensor is developed to record dynamically various physical information such as pressure, temperature, hardness, sliding velocity, and surface topography. For artificial tactile cognition, the tactile feeling of humans to various tactile materials ranging from smooth/soft to rough are assessed and found variation among participants. Because tactile responses vary among humans, a deep learning structure is designed to allow personalization through training based on individualized histograms of human tactile cognition and recording physical tactile information. The decision error in each avatar system is less than 2% when 42 materials are used to measure the tactile data with 100 trials for each material under 1.2N of contact force with 4cm s-1 of sliding velocity. As a tactile avatar, the machine categorizes newly experienced materials based on the tactile knowledge obtained from training data. The tactile sensation showed a high correlation with the specific user's tendency. This approach can be applied to electronic devices with tactile emotional exchange capabilities, as well as advanced digital experiences.

Keywords: P(VDF‐TrFE); machine learning; piezoelectric effect; tactile avatars.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Biomimetics / methods*
  • Cognition*
  • Deep Learning*
  • Female
  • Humans
  • Male
  • Touch*
  • User-Computer Interface*
  • Young Adult