Crop Disease Identification by Fusing Multiscale Convolution and Vision Transformer

Sensors (Basel). 2023 Jun 29;23(13):6015. doi: 10.3390/s23136015.

Abstract

With the development of smart agriculture, deep learning is playing an increasingly important role in crop disease recognition. The existing crop disease recognition models are mainly based on convolutional neural networks (CNN). Although traditional CNN models have excellent performance in modeling local relationships, it is difficult to extract global features. This study combines the advantages of CNN in extracting local disease information and vision transformer in obtaining global receptive fields to design a hybrid model called MSCVT. The model incorporates the multiscale self-attention module, which combines multiscale convolution and self-attention mechanisms and enables the fusion of local and global features at both the shallow and deep levels of the model. In addition, the model uses the inverted residual block to replace normal convolution to maintain a low number of parameters. To verify the validity and adaptability of MSCVT in the crop disease dataset, experiments were conducted in the PlantVillage dataset and the Apple Leaf Pathology dataset, and obtained results with recognition accuracies of 99.86% and 97.50%, respectively. In comparison with other CNN models, the proposed model achieved advanced performance in both cases. The experimental results show that MSCVT can obtain high recognition accuracy in crop disease recognition and shows excellent adaptability in multidisease recognition and small-scale disease recognition.

Keywords: convolutional neural network; crop disease recognition; image classification; self-attention mechanism; vision transformer.

MeSH terms

  • Agriculture*
  • Electric Power Supplies
  • Fabaceae*
  • Neural Networks, Computer
  • Orientation, Spatial

Grants and funding

This work was supported by a special project of “Research on teaching reform and practice based on first-class curriculum construction” of the China Society of Higher Education (2020JXD01), a special project in the key field of “artificial intelligence” in colleges and universities in Guangdong Province (2019KZDZX1027), provincial key platforms and major scientific research projects of Guangdong universities (major scientific research projects—characteristic innovation) (2017KTSCX048), Guangdong Provincial Industry College Construction Project (Artificial Intelligence Robot Education Industry College), Research on Basic and Applied Basic Research Project of Guangzhou Municipal Bureau of Science and Technology (202102080277), and Guangdong Provincial Education Department Innovation and Strengthening School Project (2020KTSCX027), scientific research project of Guangdong Bureau of Traditional Chinese Medicine (20191411).