Crowd density estimation using deep learning for Hajj pilgrimage video analytics

F1000Res. 2021 Nov 24:10:1190. doi: 10.12688/f1000research.73156.2. eCollection 2021.

Abstract

Background: This paper focuses on advances in crowd control study with an emphasis on high-density crowds, particularly Hajj crowds. Video analysis and visual surveillance have been of increasing importance in order to enhance the safety and security of pilgrimages in Makkah, Saudi Arabia. Hajj is considered to be a particularly distinctive event, with hundreds of thousands of people gathering in a small space, which does not allow a precise analysis of video footage using advanced video and computer vision algorithms. This research proposes an algorithm based on a Convolutional Neural Networks model specifically for Hajj applications. Additionally, the work introduces a system for counting and then estimating the crowd density.

Methods: The model adopts an architecture which detects each person in the crowd, spots head location with a bounding box and does the counting in our own novel dataset (HAJJ-Crowd).

Results: Our algorithm outperforms the state-of-the-art method, and attains a remarkable Mean Absolute Error result of 200 (average of 82.0 improvement) and Mean Square Error of 240 (average of 135.54 improvement).

Conclusions: In our new HAJJ-Crowd dataset for evaluation and testing, we have a density map and prediction results of some standard methods.

Keywords: CNN.; Crowd Counting; Density Estimation; Visual Surveillance.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Crowding
  • Deep Learning*
  • Humans
  • Neural Networks, Computer
  • Saudi Arabia / epidemiology

Grants and funding

This research is supported by the Multimedia University FRDGS grant (Grant No. MMUE/210030).