A novel design and implementation of wheelchair navigation system using Leap Motion sensor

Disabil Rehabil Assist Technol. 2022 May;17(4):442-448. doi: 10.1080/17483107.2020.1786734. Epub 2020 Jul 7.

Abstract

Purpose: In this paper, a novel design for a leap motion wheelchair navigation system is proposed, and the suggested model is implemented on a prototype. The behaviour of the created prototype is closely observed during the different performance tests carried out, and the results are presented throughout this manuscript.

Materials and methods: In the prototype, a Leap Motion sensor is implemented to acquire navigation data through hand gestures of the users. This navigations system design is specifically implemented to facilitate wheelchair use for amputee users and stroke patients as it does not rely on the movement of the fingers. Through this design, wheelchair movement can be controlled through detection of finger, fist, palm or wrist (for amputees) movement by the leap motion sensor. Bluetooth connection is used as the navigation system's communication means, removing the need for constant internet connection and providing freedom of movement outside of internet-covered territory. Additionally, two Dynamixel motors are used as movement force, which yield optimal computational time and minimal delay.

Results: The performance of the designed prototype is tested by considering response time and speed resolution as evaluation metrics. Results suggest that the designed wheelchair will give movement independence to users who cannot use their fingers to control the movement of their wheelchairs, while reducing delay, being independent of internet connection, providing high resolution and minimising detection error.

Conclusions: The promising results obtained from prototype testing suggest the possibility of real-life application of this wheelchair navigation system, which can greatly assist amputee users and rehabilitation patients.Implications for rehabilitationA novel wheelchair navigations system designed to facilitate amputee users, stroke patients and rehabilitation patients.The proposed system eliminates the reliance on finger movements, is gaze independent, and does not require voice or gesture control, creating much more freedom for users undergoing specific medical conditions or still under rehabilitation or treatment.Results demonstrate very low delay time in wheelchair command to action, allowing improved control for users and reducing the occurrence of control-related accidents.The designed wheelchair navigation system is independent of internet connection, allowing more freedom in range for wheelchair users compared to available cloud based models.

Keywords: Wireless wheelchair; hand gesture recognition; leap motion sensor; wheelchair hand gesture control; wheelchair navigation system.

MeSH terms

  • Equipment Design
  • Gestures
  • Humans
  • Motion
  • Movement
  • Stroke*
  • Wheelchairs*