Multimodal deep learning-based drought monitoring research for winter wheat during critical growth stages

PLoS One. 2024 May 9;19(5):e0300746. doi: 10.1371/journal.pone.0300746. eCollection 2024.

Abstract

Wheat is a major grain crop in China, accounting for one-fifth of the national grain production. Drought stress severely affects the normal growth and development of wheat, leading to total crop failure, reduced yields, and quality. To address the lag and limitations inherent in traditional drought monitoring methods, this paper proposes a multimodal deep learning-based drought stress monitoring S-DNet model for winter wheat during its critical growth periods. Drought stress images of winter wheat during the Rise-Jointing, Heading-Flowering and Flowering-Maturity stages were acquired to establish a dataset corresponding to soil moisture monitoring data. The DenseNet-121 model was selected as the base network to extract drought features. Combining the drought phenotypic characteristics of wheat in the field with meteorological factors and IoT technology, the study integrated the meteorological drought index SPEI, based on WSN sensors, and deep image learning data to build a multimodal deep learning-based S-DNet model for monitoring drought stress in winter wheat. The results show that, compared to the single-modal DenseNet-121 model, the multimodal S-DNet model has higher robustness and generalization capability, with an average drought recognition accuracy reaching 96.4%. This effectively achieves non-destructive, accurate, and rapid monitoring of drought stress in winter wheat.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • China
  • Deep Learning*
  • Droughts*
  • Seasons
  • Stress, Physiological
  • Triticum* / growth & development
  • Triticum* / physiology

Grants and funding

This work was supported in part by Major Science and Technology Projects of the Ministry of Water Resources (Grant No.SKS-2022029), Projects of Open Cooperation of Henan Academy of Sciences (Grant No.220901008) and the Key Scientific Research Projects of Henan Higher Education Institutions (No.24A520022). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.