Toward a large-scale and deep phenological stage annotation of herbarium specimens: Case studies from temperate, tropical, and equatorial floras

Appl Plant Sci. 2019 Mar 20;7(3):e01233. doi: 10.1002/aps3.1233. eCollection 2019 Mar.

Abstract

Premise of the study: Phenological annotation models computed on large-scale herbarium data sets were developed and tested in this study.

Methods: Herbarium specimens represent a significant resource with which to study plant phenology. Nevertheless, phenological annotation of herbarium specimens is time-consuming, requires substantial human investment, and is difficult to mobilize at large taxonomic scales. We created and evaluated new methods based on deep learning techniques to automate annotation of phenological stages and tested these methods on four herbarium data sets representing temperate, tropical, and equatorial American floras.

Results: Deep learning allowed correct detection of fertile material with an accuracy of 96.3%. Accuracy was slightly decreased for finer-scale information (84.3% for flower and 80.5% for fruit detection).

Discussion: The method described has the potential to allow fine-grained phenological annotation of herbarium specimens at large ecological scales. Deeper investigation regarding the taxonomic scalability of this approach is needed.

Keywords: convolutional neural network; deep learning; herbarium data; natural history collections; phenological stage annotation; visual data classification.