A Thermal Infrared Pedestrian-Detection Method for Edge Computing Devices

Sensors (Basel). 2022 Sep 5;22(17):6710. doi: 10.3390/s22176710.

Abstract

The thermal imaging pedestrian-detection system has excellent performance in different lighting scenarios, but there are problems regarding weak texture, object occlusion, and small objects. Meanwhile, large high-performance models have higher latency on edge devices with limited computing power. To solve the above problems, in this paper, we propose a real-time thermal imaging pedestrian-detection method for edge computing devices. Firstly, we utilize multi-scale mosaic data augmentation to enhance the diversity and texture of objects, which alleviates the impact of complex environments. Then, the parameter-free attention mechanism is introduced into the network to enhance features, which barely increases the computing cost of the network. Finally, we accelerate multi-channel video detection through quantization and multi-threading techniques on edge computing devices. Additionally, we create a high-quality thermal infrared dataset to facilitate the research. The comparative experiments on the self-built dataset, YDTIP, and three public datasets, with other methods show that our method also has certain advantages.

Keywords: attention mechanism; data augmentation; pedestrian detection; real-time; thermal infrared images.

Grants and funding

This work was supported, in part, by the National Key R&D Program of China (2018AAA0103300, 2018AAA0103302), Postgraduate Research & Practice Innovation Program of Jiangsu Province (KYCX22_1024), the Natural Science Foundation of Jiangsu Province (Higher Education Institutions) (BK20170900, 19KJB520046, and 20KJA520001), the Innovative and Entrepreneurial Talents Projects of Jiangsu Province, the Jiangsu Planned Projects for Postdoctoral Research Funds (No. 2019K024), the Six Talent Peaks Project in Jiangsu Province (JY02), the Postgraduate Research & Practice Innovation Program of Jiangsu Province (KYCX19_0921, KYCX19_0906), the Open Research Project of Zhejiang Lab (2021KF0AB05), and the NUPT DingShan Scholar Project and NUPTSF (NY219132).