Design and Implementation of a Hardware and Software System for Visual Assessment of Bituminous Coating Quality

Sensors (Basel). 2023 Nov 22;23(23):9325. doi: 10.3390/s23239325.

Abstract

Typically, the quality of the bitumen adhesion in asphalt mixtures is assessed manually by a group of experts who assign subjective ratings to the thickness of the residual bitumen coating on the gravel samples. To automate this process, we propose a hardware and software system for visual assessment of bituminous coating quality, which provides the results both in the form of a discrete estimate compatible with the expert one, and in a more general percentage for a set of samples. The developed methodology ensures static conditions of image capturing, insensitive to external circumstances. This is achieved by using a hardware construction designed to provide capturing the samples at eight different illumination angles. As a result, a generalized image is obtained, in which the effect of highlights and shadows is eliminated. After preprocessing, each gravel sample independently undergoes surface semantic segmentation procedure. Two most relevant approaches of semantic image segmentation were considered: gradient boosting and U-Net architecture. These approaches were compared by both stone surface segmentation accuracy, where they showed the same 77% result and the effectiveness in determining a discrete estimate. Gradient boosting showed an accuracy 2% higher than the U-Net for it and was thereby chosen as the main model when developing the prototype. According to the test results, the evaluation of the algorithm in 75% of cases completely coincided with the expert one, and it had a slight deviation from it in another 22% of cases. The developed solution allows for standardizing the data obtained and contributes to the creation of an interlaboratory digital research database.

Keywords: U-Net; adhesion; asphalt mixtures; boiling water test; gradient boosting; image analysis; surface segmentation.