Safe trajectory estimation at a pedestrian crossing to assist visually impaired people

Annu Int Conf IEEE Eng Med Biol Soc. 2012:2012:5114-7. doi: 10.1109/EMBC.2012.6347144.

Abstract

The aim of this paper is to present a service for blind and people with low vision to assist them to cross the street independently. The presented approach provides the user with significant information such as detection of pedestrian crossing signal from any point of view, when the pedestrian crossing signal light is green, the detection of dynamic and fixed obstacles, predictions of the movement of fellow pedestrians and information on objects which may intersect his path. Our approach is based on capturing multiple frames using a depth camera which is attached to a user's headgear. Currently a testbed system is built on a helmet and is connected to a laptop in the user's backpack. In this paper, we discussed efficiency of using Speeded-Up Robust Features (SURF) algorithm for object recognition for purposes of blind people assistance. The system predicts the movement of objects of interest to provide the user with information on the safest path to navigate and information on the surrounding area. Evaluation of this approach on real sequence video frames provides 90% of human detection and more than 80% for recognition of other related objects.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Acoustic Stimulation / instrumentation*
  • Artificial Intelligence*
  • Biofeedback, Psychology / instrumentation
  • Blindness / rehabilitation*
  • Equipment Design
  • Equipment Failure Analysis
  • Humans
  • Imaging, Three-Dimensional / instrumentation*
  • Sensory Aids*
  • Therapy, Computer-Assisted / instrumentation*
  • Visually Impaired Persons / rehabilitation*