Human-Robot Interaction Using Learning from Demonstrations and a Wearable Glove with Multiple Sensors

Sensors (Basel). 2023 Dec 12;23(24):9780. doi: 10.3390/s23249780.

Abstract

Human-robot interaction is of the utmost importance as it enables seamless collaboration and communication between humans and robots, leading to enhanced productivity and efficiency. It involves gathering data from humans, transmitting the data to a robot for execution, and providing feedback to the human. To perform complex tasks, such as robotic grasping and manipulation, which require both human intelligence and robotic capabilities, effective interaction modes are required. To address this issue, we use a wearable glove to collect relevant data from a human demonstrator for improved human-robot interaction. Accelerometer, pressure, and flexi sensors were embedded in the wearable glove to measure motion and force information for handling objects of different sizes, materials, and conditions. A machine learning algorithm is proposed to recognize grasp orientation and position, based on the multi-sensor fusion method.

Keywords: flexi sensors; human–robot interaction; inertia; learning from demonstration; pressure; robotic grasping; wearable devices.

MeSH terms

  • Algorithms
  • Hand Strength
  • Humans
  • Machine Learning
  • Robotics* / methods
  • Wearable Electronic Devices*