Multimodal remote sensing application for weed competition time series analysis in maize farmland ecosystems

Abstract

Although weeds cause serious harm to crops through competition for resources, they also have ecological functions. We need to study the change law of competition between crops and weeds, and achieve scientific farmland weed management under the premise of protecting weed biodiversity. In the research, we perform a competitive experiment in Harbin, China, in 2021, with five periods of maize as the study subjects. Comprehensive competition indices (CCI-A) based on maize phenotypes were used to describe the dynamic processes and results of weeds competition. The relation between in structural and biochemical information of maize and weed competitive intensity (Levels 1-5) at different periods and the effects on yield parameters were analyzed. The results showed that the differences of maize plant height, stalk thickness, and N and P elements among different competition levels (Levels 1-5) changed significantly with increasing competition time. This directly resulted in 10%, 31%, 35% and 53% decrease in maize yield; and 3%, 7%, 9% and 15% decrease in hundred grain weight. Compared to the conventional competition indices, CCI-A had better dispersion in the last four periods and was more suitable for quantifying the time-series response of competition. Then, multi-source remote sensing technologies are applied to reveal the temporal response of spectral and lidar information to community competition. The first-order derivatives of the spectra indicate that the red edge (RE) of competition stressed plots biased in short-wave direction in each period. With increasing competition time, RE of Levels 1-5 shifted towards the long wave direction as a whole. The coefficients of variation of canopy height model (CHM) indicate that weed competition had a significant effect on CHM. Finally, the deep learning model with multimodal data (Mul-3DCNN) is created to achieve a large range of CCI-A predictions for different periods, and achieves a prediction accuracy of R² = 0.85 and RMSE = 0.095. Overall, this study use of CCI-A indices combined with multimodal temporal remote sensing imagery and DL to achieve large scale prediction of weed competitiveness in different periods of maize.

Keywords: Deep learning; Farmland ecosystems; Hyperspectral remote sensing; Lidar remote sensing; UAV time Series analysis; Weed competition.