Improved Monitoring of Wildlife Invasion through Data Augmentation by Extract-Append of a Segmented Entity

Sensors (Basel). 2022 Sep 28;22(19):7383. doi: 10.3390/s22197383.

Abstract

Owing to the continuous increase in the damage to farms due to wild animals' destruction of crops in South Korea, various methods have been proposed to resolve these issues, such as installing electric fences and using warning lamps or ultrasonic waves. Recently, new methods have been attempted by applying deep learning-based object-detection techniques to a robot. However, for effective training of a deep learning-based object-detection model, overfitting or biased training should be avoided; furthermore, a huge number of datasets are required. In particular, establishing a training dataset for specific wild animals requires considerable time and labor. Therefore, this study proposes an Extract-Append data augmentation method where specific objects are extracted from a limited number of images via semantic segmentation and corresponding objects are appended to numerous arbitrary background images. Thus, the study aimed to improve the model's detection performance by generating a rich dataset on wild animals with various background images, particularly images of water deer and wild boar, which are currently causing the most problematic social issues. The comparison between the object detector trained using the proposed Extract-Append technique and that trained using the existing data augmentation techniques showed that the mean Average Precision (mAP) improved by ≥2.2%. Moreover, further improvement in detection performance of the deep learning-based object-detection model can be expected as the proposed technique can solve the issue of the lack of specific data that are difficult to obtain.

Keywords: data augmentation; object detection; semantic segmentation; surveillance.

MeSH terms

  • Animals
  • Animals, Wild
  • Deep Learning*
  • Deer*
  • Semantics