Stereo vision tracking of multiple objects in complex indoor environments

Sensors (Basel). 2010;10(10):8865-87. doi: 10.3390/s101008865. Epub 2010 Sep 28.

Abstract

This paper presents a novel system capable of solving the problem of tracking multiple targets in a crowded, complex and dynamic indoor environment, like those typical of mobile robot applications. The proposed solution is based on a stereo vision set in the acquisition step and a probabilistic algorithm in the obstacles position estimation process. The system obtains 3D position and speed information related to each object in the robot's environment; then it achieves a classification between building elements (ceiling, walls, columns and so on) and the rest of items in robot surroundings. All objects in robot surroundings, both dynamic and static, are considered to be obstacles but the structure of the environment itself. A combination of a Bayesian algorithm and a deterministic clustering process is used in order to obtain a multimodal representation of speed and position of detected obstacles. Performance of the final system has been tested against state of the art proposals; test results validate the authors' proposal. The designed algorithms and procedures provide a solution to those applications where similar multimodal data structures are found.

Keywords: 3D tracking; Bayesian estimation; mobile robots; stereo vision sensor.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Artificial Intelligence
  • Bayes Theorem
  • Cluster Analysis
  • Environment
  • Pattern Recognition, Automated / methods*
  • Robotics / methods*