Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices

Zhiwen Mi; Xudong Zhang; Jinya Su; Dejun Han; Baofeng Su

doi:10.3389/fpls.2020.558126

Wheat Stripe Rust Grading by Deep Learning With Attention Mechanism and Images From Mobile Devices

Front Plant Sci. 2020 Sep 9:11:558126. doi: 10.3389/fpls.2020.558126. eCollection 2020.

Authors

Zhiwen Mi^{1

2

3}, Xudong Zhang^{1

2

3}, Jinya Su⁴, Dejun Han⁵, Baofeng Su^{1

2

3}

Affiliations

¹ College of Mechanical and Electronic Engineering, Northwest A&F University, Yangling, China.
² Key Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Yangling, China.
³ Shaanxi Key Laboratory of Agricultural Information Perception and Intelligent Services, Yangling, China.
⁴ School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom.
⁵ State Key Laboratory of Crop Stress Biology for Arid Areas and College of Plant Protection, Northwest A&F University, Yangling, China.

Abstract

Wheat stripe rust is one of the main wheat diseases worldwide, which has significantly adverse effects on wheat yield and quality, posing serious threats on food security. Disease severity grading plays a paramount role in stripe rust disease management including breeding disease-resistant wheat varieties. Manual inspection is time-consuming, labor-intensive and prone to human errors, therefore, there is a clearly urgent need to develop more effective and efficient disease grading strategy by using automated approaches. However, the differences between wheat leaves of different levels of stripe rust infection are usually tiny and subtle, and, as a result, ordinary deep learning networks fail to achieve satisfying performance. By formulating this challenge as a fine-grained image classification problem, this study proposes a novel deep learning network C-DenseNet which embeds Convolutional Block Attention Module (CBAM) in the densely connected convolutional network (DenseNet). The performance of C-DenseNet and its variants is demonstrated via a newly collected wheat stripe rust grading dataset (WSRgrading dataset) at Northwest A&F University, Shaanxi Province, China, which contains a total of 5,242 wheat leaf images with 6 levels of stripe rust infection. The dataset was collected by using various mobile devices in the natural field condition. Comparative experiments show that C-DenseNet with a test accuracy of 97.99% outperforms the classical DenseNet (92.53%) and ResNet (73.43%). GradCAM++ network visualization also shows that C-DenseNet is able to pay more attention to the key areas in making the decision. It is concluded that C-DenseNet with an attention mechanism is suitable for wheat stripe rust disease grading in field conditions.

Keywords: C-DenseNet; CBAM module; attention mechanism; disease grading; wheat stripe rust.