First use of unmanned aerial vehicles to monitor Halyomorpha halys and recognize it using artificial intelligence

Background: Halyomorpha halys is one of the most damaging invasive agricultural pests in North America and southern Europe. It is commonly monitored using pheromone traps, which are not very effective because few bugs are caught and some escape and/or remain outside the trap on surrounding plants where they feed, increasing the damage. Other monitoring techniques are based on visual sampling, sweep-netting and tree-beating. However, all these methods require several hours of human labor and are difficult to apply to large areas. The aim of this work is to develop an automated monitoring system that integrates image acquisition through the use of drones with H. halys detection through the use of artificial intelligence (AI).

Results: The study results allowed the development of an automated flight protocol using a mobile app to capture high-resolution images. The drone caused only low levels of disturbance in both adult and intermediate instars, inducing freezing behavior in adults. Each of the AI models used achieved very good performance, with a detection accuracy of up to 97% and recall of up to 87% for the X-TL model.

Conclusion: The first application of this novel monitoring system demonstrated the potential of drones and AI to detect and quantify the presence of H. halys. The ability to capture high-altitude, high-resolution images makes this method potentially suitable for use with a range of crops and pests. © 2024 Society of Chemical Industry.