Classification modeling method for hyperspectral stamp-pad ink data based on one-dimensional convolutional neural network

J Forensic Sci. 2022 Mar;67(2):550-561. doi: 10.1111/1556-4029.14909. Epub 2021 Oct 7.

Abstract

In the questioned document, the examination of stamp-pad ink is crucial scientific evidence to discern the difference between genuine and forged documents. In this study, a new method for rapid and non-destructive identification of types of stamp-pad inks by combining hyperspectral imaging (HSI) technology and deep learning was developed. Twenty stamp-pad inks of different brands and models were collected and numbered in turn, and then, each of them was sealed six times repeatedly on the A4 printing paper for the test. After that, the hyperspectral imager was used to collect the hyperspectral images and the reflectance spectral data were obtained after pixel fusion. Principal component analysis (PCA) and non-negative matrix factorization (NMF) were used to deal with the dataset, but visual results were not good. Then, back propagation neural network (BPNN) and one-dimensional convolutional neural network (1D-CNN) were constructed and their merits and drawbacks were compared. The final loss function of the BPNN of training set and validation set was stable at 0.27 and 0.42, and the classification accuracy of the training set and validation set reached 90.02% and 83.99%, respectively. Compared with the BPNN, the 1D-CNN had better stability and efficiency for the classification. The loss function of the training set and validation set was as low as 0.068 and 0.075, and the final classification accuracy reached 98.30% and 97.94%, respectively. Therefore, the combination of hyperspectral imaging technology and 1D-CNN represents a potentially simple, non-destructive, and rapid method for stamp-pad inks detection and classification.

Keywords: 1D-CNN; BPNN; HIS; NMF; PCA; back propagation neural network; classification; hyperspectral imaging; non-negative matrix factorization; one-dimensional convolutional neural network; principal component analysis; stamp-pad ink.