Deep learning-based efficient drone-borne sensing of cyanobacterial blooms using a clique-based feature extraction approach

Abstract

Recent advances in remote sensing techniques provide a new horizon for monitoring the spatiotemporal variations of harmful algal blooms (HABs) using hyperspectral data in inland water. In this study, a hierarchical concatenated variational autoencoder (HCVAE) is proposed as an efficient and accurate deep learning (DL) based bio-optical model. To demonstrate its usefulness in retrieving algal pigments, the HCVAE is applied to bloom-prone regions in Daecheong Lake, South Korea. By abstracting the similarity between highly related features using layer-wise clique-based latent-feature extraction, HCVAE reduces the computational loads in deriving outputs while preventing performance degradation. Graph-based clique-detection uses information theory-based criteria to group the related reflectance spectra. Consequently, six latent features were extracted from 79 spectral bands to consist of a multilevel hierarchy of HCVAE that can simultaneously estimate concentrations of chlorophyll-a (Chl-a) and phycocyanin (PC). Despite the parsimonious model architecture, the Chl-a and PC concentrations estimated by HCVAE closely agree with the measured concentrations, with test R² values of 0.76 and 0.82, respectively. In addition, spatial distribution maps of algal pigments obtained from HCVAE using drone-borne reflectance successfully capture the blooming spots. Based on its multilevel hierarchical architecture, HCVAE can provide the importance of latent features along with their individual wavelengths using Shapley additive explanations. The most important latent features covered the spectral regions associated with both Chl-a and PC. The lightweight neural network DNN_sel, which uses only the spectral bands of highest importance in latent-feature extraction, performed comparably to HCVAE. The study results demonstrate the utility of the multilevel hierarchical architecture as a comprehensive assessment model for near-real-time drone-borne sensing of HABs. Moreover, HCVAE is applicable to a wide range of environmental big data, as it can handle numerous sets of features.

Keywords: Algal pigment; Drone-borne sensing; Explainable artificial intelligence; Hyperspectral imagery; Latent-feature extraction; Variational autoencoder.