Utility of Spectral Filtering to Improve the Reliability of Marine Fauna Detections from Drone-Based Monitoring

Sensors (Basel). 2023 Nov 15;23(22):9193. doi: 10.3390/s23229193.

Abstract

Monitoring marine fauna is essential for mitigating the effects of disturbances in the marine environment, as well as reducing the risk of negative interactions between humans and marine life. Drone-based aerial surveys have become popular for detecting and estimating the abundance of large marine fauna. However, sightability errors, which affect detection reliability, are still apparent. This study tested the utility of spectral filtering for improving the reliability of marine fauna detections from drone-based monitoring. A series of drone-based survey flights were conducted using three identical RGB (red-green-blue channel) cameras with treatments: (i) control (RGB), (ii) spectrally filtered with a narrow 'green' bandpass filter (transmission between 525 and 550 nm), and, (iii) spectrally filtered with a polarising filter. Video data from nine flights comprising dolphin groups were analysed using a machine learning approach, whereby ground-truth detections were manually created and compared to AI-generated detections. The results showed that spectral filtering decreased the reliability of detecting submerged fauna compared to standard unfiltered RGB cameras. Although the majority of visible contrast between a submerged marine animal and surrounding seawater (in our study, sites along coastal beaches in eastern Australia) is known to occur between 515-554 nm, isolating the colour input to an RGB sensor does not improve detection reliability due to a decrease in the signal to noise ratio, which affects the reliability of detections.

Keywords: drone-based monitoring; machine learning analysis; marine fauna detection; shark-bite mitigation; sightability error; spectral filtering.

MeSH terms

  • Animals
  • Australia
  • Humans
  • Reproducibility of Results
  • Seawater*
  • Unmanned Aerial Devices*

Grants and funding

This project was funded by the NSW Government through the NSW Shark Management Program.