Teleoperation of High-Speed Robot Hand with High-Speed Finger Position Recognition and High-Accuracy Grasp Type Estimation

Sensors (Basel). 2022 May 16;22(10):3777. doi: 10.3390/s22103777.

Abstract

This paper focuses on the teleoperation of a robot hand on the basis of finger position recognition and grasp type estimation. For the finger position recognition, we propose a new method that fuses machine learning and high-speed image-processing techniques. Furthermore, we propose a grasp type estimation method according to the results of the finger position recognition by using decision tree. We developed a teleoperation system with high speed and high responsiveness according to the results of the finger position recognition and grasp type estimation. By using the proposed method and system, we achieved teleoperation of a high-speed robot hand. In particular, we achieved teleoperated robot hand control beyond the speed of human hand motion.

Keywords: finger position recognition; grasp type estimation; high-speed image processing; machine learning; teleoperation.

MeSH terms

  • Fingers
  • Hand
  • Hand Strength
  • Humans
  • Motion
  • Robotics* / methods

Grants and funding

This research was supported in part by the JST, PRESTO Grant Number JPMJPR17J9, Japan.