Small-Scale Urban Object Anomaly Detection Using Convolutional Neural Networks with Probability Estimation

Sensors (Basel). 2023 Aug 15;23(16):7185. doi: 10.3390/s23167185.

Abstract

Anomaly detection in sequences is a complex problem in security and surveillance. With the exponential growth of surveillance cameras in urban roads, automating them to analyze the data and automatically identify anomalous events efficiently is essential. This paper presents a methodology to detect anomalous events in urban sequences using pre-trained convolutional neural networks (CNN) and super-resolution (SR) models. The proposal is composed of two parts. In the offline stage, the pre-trained CNN model evaluated a large dataset of urban sequences to detect and establish the common locations of the elements of interest. Analyzing the offline sequences, a density matrix is calculated to learn the spatial patterns and identify the most frequent locations of these elements. Based on probabilities previously calculated from the offline analysis, the pre-trained CNN, now in an online stage, assesses the probability of anomalies appearing in the real-time sequence using the density matrix. Experimental results demonstrate the effectiveness of the presented approach in detecting several anomalies, such as unusual pedestrian routes. This research contributes to urban surveillance by providing a practical and reliable method to improve public safety in urban environments. The proposed methodology can assist city management authorities in proactively detecting anomalies, thus enabling timely reaction and improving urban safety.

Keywords: anomaly detection; convolutional neural network; super-resolution.

Grants and funding

This work is partially supported by the Autonomous Government of Andalusia (Spain) under project UMA20-FEDERJA-108, project name “Detection, Characterization and Prognosis Value of the Non-Obstructive Coronary Disease with Deep Learning”, and also by the Ministry of Science and Innovation of Spain, grant number PID2022-136764OA-I00, project name “Automated Detection of Non Lesional Focal Epilepsy by Probabilistic Diffusion Deep Neural Models”. It includes funds from the European Regional Development Fund (ERDF). It is also partially supported by the University of Málaga (Spain) under grants B1-2019_01, project name “Anomaly detection on roads by moving cameras”; B1-2019_02, project name “Self-Organizing Neural Systems for Non-Stationary Environments”; B1-2021_20, project name “Detection of coronary stenosis using deep learning applied to coronary angiography”, B4-2022, project name “Intelligent Clinical Decision Support System for Non-Obstructive Coronary Artery Disease in Coronarographies”; B1-2022_14, project name “Detección de Trayectorias Anómalas de Vehículos en Cámaras de Tráfico”. The authors thankfully acknowledge the computer resources, technical expertise and assistance provided by the SCBI (Supercomputing and Bioinformatics) center of the University of Málaga. They also gratefully acknowledge the support of NVIDIA Corporation (Santa Clara, CA, USA) with the donation of a RTX A6000 GPU with 48 GB of VRAM memory. The authors also thankfully acknowledge the grant of the Universidad de Málaga and the Instituto de Investigación Biomédica de Málaga y Plataforma en Nanomedicina-IBIMA Plataforma BIONAND.