Assessment of deep convolutional neural network models for species identification of forensically-important fly maggots based on images of posterior spiracles

Darlin Apasrawirote; Pharinya Boonchai; Paisarn Muneesawang; Wannacha Nakhonkam; Nophawan Bunchu

doi:10.1038/s41598-022-08823-8

Assessment of deep convolutional neural network models for species identification of forensically-important fly maggots based on images of posterior spiracles

Sci Rep. 2022 Mar 19;12(1):4753. doi: 10.1038/s41598-022-08823-8.

Authors

Darlin Apasrawirote¹, Pharinya Boonchai², Paisarn Muneesawang², Wannacha Nakhonkam³, Nophawan Bunchu⁴

Affiliations

¹ Department of Business Administration, Faculty of Business Economics and Communications, Naresuan University, Muang, Phitsanulok, 65000, Thailand.
² Department of Electrical and Computer Engineering, Faculty of Engineering, Naresuan University, Muang, Phitsanulok, 65000, Thailand.
³ Department of Microbiology and Parasitology, Faculty of Medical Science, Naresuan University, Muang, Phitsanulok, 65000, Thailand.
⁴ Department of Microbiology and Parasitology, Faculty of Medical Science, Naresuan University, Muang, Phitsanulok, 65000, Thailand. nophawanb@nu.ac.th.

Abstract

Forensic entomology is the branch of forensic science that is related to using arthropod specimens found in legal issues. Fly maggots are one of crucial pieces of evidence that can be used for estimating post-mortem intervals worldwide. However, the species-level identification of fly maggots is difficult, time consuming, and requires specialized taxonomic training. In this work, a novel method for the identification of different forensically-important fly species is proposed using convolutional neural networks (CNNs). The data used for the experiment were obtained from a digital camera connected to a compound microscope. We compared the performance of four widely used models that vary in complexity of architecture to evaluate tradeoffs in accuracy and speed for species classification including ResNet-101, Densenet161, Vgg19_bn, and AlexNet. In the validation step, all of the studied models provided 100% accuracy for identifying maggots of 4 species including Chrysomya megacephala (Diptera: Calliphoridae), Chrysomya (Achoetandrus) rufifacies (Diptera: Calliphoridae), Lucilia cuprina (Diptera: Calliphoridae), and Musca domestica (Diptera: Muscidae) based on images of posterior spiracles. However, AlexNet showed the fastest speed to process the identification model and presented a good balance between performance and speed. Therefore, the AlexNet model was selected for the testing step. The results of the confusion matrix of AlexNet showed that misclassification was found between C. megacephala and C. (Achoetandrus) rufifacies as well as between C. megacephala and L. cuprina. No misclassification was found for M. domestica. In addition, we created a web-application platform called thefly.ai to help users identify species of fly maggots in their own images using our classification model. The results from this study can be applied to identify further species by using other types of images. This model can also be used in the development of identification features in mobile applications. This study is a crucial step for integrating information from biology and AI-technology to develop a novel platform for use in forensic investigation.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Animals
Calliphoridae
Diptera*
Forensic Entomology*
Forensic Sciences / methods
Larva
Muscidae*
Neural Networks, Computer