Augmented-reality based brain-computer interface of robot control

Heliyon. 2024 Feb 20;10(5):e26255. doi: 10.1016/j.heliyon.2024.e26255. eCollection 2024 Mar 15.

Abstract

Brain Computer Interface (BCI) is a new approach to human-computer interaction. It can control the external devices directly with the brain without words and body movements. Brain-controlled robot is a major research area in the field of BCI, which organically integrates BCI with robotic systems to achieve safe and effective real-time control of robots using the user's electroencephalogram (EEG). Currently, there are two types of control methods for brain-controlled robots. One is direct control and the other is shared control. Direct brain control has its shortcomings, namely, low control efficiency and easy user fatigue. Shared control technique can effectively improve the control of brain-controlled robots and reduce the thinking ability of brain-controlled robots, thus making it the main control method of brain-controlled robots. The brain-computer collaborative control system based on augmented reality (AR) technology studied in this paper is a human-computer shared control method. In the experimental analysis of virtual reality (VR) systems and AR systems, this paper processes polylines through a series of control vertices with specific coordinates, using the relative distance measured between each point and the starting point as the relative coordinates, and calculates the operational errors of the two types of systems. In the system error of machining broken lines, when the relative coordinates are (10, 20), (40, 50), and (70, 80), the error values of the VR system are 0.17 mm, 0.36 mm, and 0.55 mm, respectively, while the error values of the AR system are 0.11 mm, 0.24 mm, and 0.41 mm, respectively. Therefore, the studies have illustrated the importance of AR systems for the study of brain-computer collaborative control of robots.

Keywords: Augmented reality; Brain computer collaborative control; Brain computer interface; Brain-controlled mobile robot.