Programming Robots by Demonstration Using Augmented Reality

Sensors (Basel). 2021 Sep 6;21(17):5976. doi: 10.3390/s21175976.

Abstract

The world is living the fourth industrial revolution, marked by the increasing intelligence and automation of manufacturing systems. Nevertheless, there are types of tasks that are too complex or too expensive to be fully automated, it would be more efficient if the machines were able to work with the human, not only by sharing the same workspace but also as useful collaborators. A possible solution to that problem is on human-robot interaction systems, understanding the applications where they can be helpful to implement and what are the challenges they face. This work proposes the development of an industrial prototype of a human-machine interaction system through Augmented Reality, in which the objective is to enable an industrial operator without any programming experience to program a robot. The system itself is divided into two different parts: the tracking system, which records the operator's hand movement, and the translator system, which writes the program to be sent to the robot that will execute the task. To demonstrate the concept, the user drew geometric figures, and the robot was able to replicate the operator's path recorded.

Keywords: augmented reality; collaborative robots; industrial robots; programming by demonstration.

MeSH terms

  • Augmented Reality*
  • Automation
  • Humans
  • Industry
  • Movement
  • Robotics*