Interactive serious game for shoulder rehabilitation based on real-time hand tracking

Technol Health Care. 2020;28(4):403-414. doi: 10.3233/THC-192081.

Abstract

Background: Virtual reality is becoming popular in the rehabilitation field thanks to the several advantages it can offer to patients and physicians. Indeed, serious games can: motivate and engage the patient; offer different levels of challenge and difficulty based on the patient baseline, and integrate objective measures of the patient's performance during each rehabilitation session.

Objective: We designed and implemented a serious game for shoulder rehabilitation based on real-time hand tracking. The aim was to maintain the medical benefits of traditional rehabilitation, while reducing human resources and costs and facilitating active patient participation.

Methods: Our software application provides the user with a shoulder horizontal adduction exercise. This exercise takes place in a 2D interactive game environment, controlled by hand movements on a desk pad. The hardware includes a standard desktop computer and screen, and the Leap Motion Controller: a hand tracking system. Changing the desk pad material allows the physiotherapist to vary the friction between the user hand and the supporting surface.

Results: Fourteen healthy volunteers and six rehabilitation experts tested our serious game. The results showed that the application is attractive, ergonomic and clinically useful.

Conclusion: Despite promising results, clinical validation is necessary to demonstrate the efficacy of the serious game.

Keywords: Leap Motion Controller; Serious game; shoulder disorders; virtual rehabilitation.

MeSH terms

  • Exergaming*
  • Hand*
  • Humans
  • Shoulder*
  • Virtual Reality