Sensor Fusion-Based Teleoperation Control of Anthropomorphic Robotic Arm

Biomimetics (Basel). 2023 Apr 20;8(2):169. doi: 10.3390/biomimetics8020169.

Abstract

Sensor fusion is a technique that combines information from multiple sensors in order to improve the accuracy and reliability of the data being collected. In the context of teleoperation control of an anthropomorphic robotic arm, sensor fusion technology can be used to enhance the precise control of anthropomorphic robotic arms by combining data from multiple sensors, such as cameras, data gloves, force sensors, etc. By fusing and processing this sensing information, it can enable real-time control of anthropomorphic robotic arms and dexterous hands, replicating the motion of human manipulators. In this paper, we present a sensor fusion-based teleoperation control system for the anthropomorphic robotic arm and dexterous hand, which utilizes a filter to fuse data from multiple sensors in real-time. As such, the real-time perceived human arms motion posture information is analyzed and processed, and wireless communication is used to intelligently and flexibly control the anthropomorphic robotic arm and dexterous hand. Finally, the user is able to manage the anthropomorphic operation function in a stable and reliable manner. We also discussed the implementation and experimental evaluation of the system, showing that it is able to achieve improved performance and stability compared to traditional teleoperation control methods.

Keywords: anthropomorphic robotic arm; sensor fusion; teleoperation control.

Grants and funding

This study was partially funded by the Project of Shandong High-end Medical Device Innovation and Entrepreneurship Community (2022-SGTTXM-018). This work was also supported by research grants from The Shandong Intelligent Medicine Ltd.