Automatic pavement texture recognition using lightweight few-shot learning

Philos Trans A Math Phys Eng Sci. 2023 Sep 4;381(2254):20220166. doi: 10.1098/rsta.2022.0166. Epub 2023 Jul 17.

Abstract

Texture is a crucial characteristic of roads, closely related to their performance. The recognition of pavement texture is of great significance for road maintenance professionals to detect potential safety hazards and carry out necessary countermeasures. Although deep learning models have been applied for recognition, the scarcity of data has always been a limitation. To address this issue, this paper proposes a few-shot learning model based on the Siamese network for pavement texture recognition with a limited dataset. The model achieved 89.8% accuracy in a four-way five-shot task classifying the pavement textures of dense asphalt concrete, micro surface, open-graded friction course and stone matrix asphalt. To align with engineering practice, global average pooling (GAP) and one-dimensional convolution are implemented, creating lightweight models that save storage and training time. Comparative experiments show that the lightweight model with GAP implemented on dense layers and one-dimensional convolution on convolutional layers reduced storage volume by 94% and training time by 99%, despite a 2.9% decrease in classification accuracy. Moreover, the model with only GAP implemented on dense layers achieved the highest accuracy at 93.5%, while reducing storage volume and training time by 83% and 6%, respectively. This article is part of the theme issue 'Artificial intelligence in failure analysis of transportation infrastructure and materials'.

Keywords: Siamese network; convolutional neural network; deep learning; one-dimensional convolution; pavement detection.