Tracking Multiple Vehicles Constrained to a Road Network From a UAV with Sparse Visual Measurements

Abstract

Multiple-target tracking algorithms generally operate in the local frame of the sensor and have difficulty with track reallocation when targets move in and out of the sensor field-of-view. This poses a problem when an unmanned aerial vehicle (UAV) is tracking multiple ground targets on a road network larger than its field-of-view. To address this problem, we propose a Rao-Blackwellized Particle Filter (RBPF) to maintain individual target tracks and to perform probabilistic data association when the targets are constrained to a road network. This is particularly useful when a target leaves and then re-enters the UAV's field-of-view. The RBPF is structured as a particle filter of particle filters. The top level filter handles data association and each of its particles maintains a bank of particle filters to handle target tracking. The tracking particle filters incorporate both positive and negative information when a measurement is received. We implement two path planning controllers, receding horizon and deep reinforcement learning, and compare their ability to improve the certainty for multiple target location estimates. The controllers prioritize paths that reduce each target's entropy. In addition, we develop an algorithm that computes the upper bound on the filter's performance, thus facilitating an estimate of the number of UAVs needed to achieve a desired performance threshold.

Keywords: computer vision; cooperative control; multiple target tracking; particle filter; unmanned air vehicles.