Deep Learning Enables Instant and Versatile Estimation of Rice Yield Using Ground-Based RGB Images

Plant Phenomics. 2023 Jul 28:5:0073. doi: 10.34133/plantphenomics.0073. eCollection 2023.

Abstract

Rice (Oryza sativa L.) is one of the most important cereals, which provides 20% of the world's food energy. However, its productivity is poorly assessed especially in the global South. Here, we provide a first study to perform a deep-learning-based approach for instantaneously estimating rice yield using red-green-blue images. During ripening stage and at harvest, over 22,000 digital images were captured vertically downward over the rice canopy from a distance of 0.8 to 0.9 m at 4,820 harvesting plots having the yield of 0.1 to 16.1 t·ha-1 across 6 countries in Africa and Japan. A convolutional neural network applied to these data at harvest predicted 68% variation in yield with a relative root mean square error of 0.22. The developed model successfully detected genotypic difference and impact of agronomic interventions on yield in the independent dataset. The model also demonstrated robustness against the images acquired at different shooting angles up to 30° from right angle, diverse light environments, and shooting date during late ripening stage. Even when the resolution of images was reduced (from 0.2 to 3.2 cm·pixel-1 of ground sampling distance), the model could predict 57% variation in yield, implying that this approach can be scaled by the use of unmanned aerial vehicles. Our work offers low-cost, hands-on, and rapid approach for high-throughput phenotyping and can lead to impact assessment of productivity-enhancing interventions, detection of fields where these are needed to sustainably increase crop production, and yield forecast at several weeks before harvesting.

Grants and funding

We are grateful for the financial support to this study by the European Union and International Fund for Agricultural Development (IFAD) under the project “Sustainable and Diversified Rice-based Farming Systems (DCIFOOD/2015/360-968)” under the program “Putting Research into Use for Nutrition, Sustainable Agriculture and Resilience (PRUNSAR)” (to K. Saito), CGIAR Research Program (CRP) on rice agri-food systems (to K.S.), JSPS KAKENHI grant nos. 19H02939, 20H02968, and 21K19104 (to Y. Tanaka), and JICA/JST SATREPS, Japan grant no. JPMJSA1608 (to Y. Tsujimoto).