CMRD-Net: a deep learning-based Cnaphalocrocis medinalis damage symptom rotated detection framework for in-field survey

Tianjiao Chen; Rujing Wang; Jianming Du; Hongbo Chen; Jie Zhang; Wei Dong; Meng Zhang

doi:10.3389/fpls.2023.1180716

CMRD-Net: a deep learning-based Cnaphalocrocis medinalis damage symptom rotated detection framework for in-field survey

Front Plant Sci. 2023 Jun 8:14:1180716. doi: 10.3389/fpls.2023.1180716. eCollection 2023.

Authors

Tianjiao Chen^{1

2}, Rujing Wang^{1

2

3}, Jianming Du¹, Hongbo Chen^{1

2}, Jie Zhang¹, Wei Dong⁴, Meng Zhang⁵

Affiliations

¹ Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei, China.
² Science Island Branch, University of Science and Technology of China, Hefei, China.
³ Institutes of Physical Science and Information Technology, Anhui University, Hefei, China.
⁴ Agricultural Economy and Information Research Institute, Anhui Academy of Agricultural Sciences, Hefei, China.
⁵ Jingxian Plant Protection Station, Jingxian Plantation Technology Extension Center, Xuancheng, China.

Abstract

The damage symptoms of Cnaphalocrocis medinalis (C.medinalis) is an important evaluation index for pest prevention and control. However, due to various shapes, arbitrary-oriented directions and heavy overlaps of C.medinalis damage symptoms under complex field conditions, generic object detection methods based on horizontal bounding box cannot achieve satisfactory results. To address this problem, we develop a Cnaphalocrocis medinalis damage symptom rotated detection framework called CMRD-Net. It mainly consists of a Horizontal-to-Rotated region proposal network (H2R-RPN) and a Rotated-to-Rotated region convolutional neural network (R2R-RCNN). First, the H2R-RPN is utilized to extract rotated region proposals, combined with adaptive positive sample selection that solves the hard definition of positive samples caused by oriented instances. Second, the R2R-RCNN performs feature alignment based on rotated proposals, and exploits oriented-aligned features to detect the damage symptoms. The experimental results on our constructed dataset show that our proposed method outperforms those state-of-the-art rotated object detection algorithms achieving 73.7% average precision (AP). Additionally, the results demonstrate that our method is more suitable than horizontal detection methods for in-field survey of C.medinalis.

Keywords: Cnaphalocrocis medinalis; damage symptom; deep learning; horizontal object detection; rotated object detection.

Grants and funding

This work was supported by the National Natural Science Foundation of China under grant (No.32171888), the major special project of Anhui Province Science and Technology (No.2020b06050001) and the Natural Science Foundation of Anhui Province (No.2208085MC57).