Real-Time Person Detection in Wooded Areas Using Thermal Images from an Aerial Perspective

Sensors (Basel). 2023 Nov 16;23(22):9216. doi: 10.3390/s23229216.

Abstract

Detecting people in images and videos captured from an aerial platform in wooded areas for search and rescue operations is a current problem. Detection is difficult due to the relatively small dimensions of the person captured by the sensor in relation to the environment. The environment can generate occlusion, complicating the timely detection of people. There are currently numerous RGB image datasets available that are used for person detection tasks in urban and wooded areas and consider the general characteristics of a person, like size, shape, and height, without considering the occlusion of the object of interest. The present research work focuses on developing a thermal image dataset, which considers the occlusion situation to develop CNN convolutional deep learning models to perform detection tasks in real-time from an aerial perspective using altitude control in a quadcopter prototype. Extended models are proposed considering the occlusion of the person, in conjunction with a thermal sensor, which allows for highlighting the desired characteristics of the occluded person.

Keywords: CNN; UAV; robust control.

Grants and funding

This project was funded by Aerial and Submarine Autonomous Navigation Systems PhD program of Research and Advanced Studies Center (CINVESTAV) of the National Polytechnic Institute.