Age prediction by deep learning applied to Greenland halibut (Reinhardtius hippoglossoides) otolith images

PLoS One. 2022 Nov 4;17(11):e0277244. doi: 10.1371/journal.pone.0277244. eCollection 2022.

Abstract

Otoliths (ear-stones) in the inner ears of vertebrates containing visible year zones are used extensively to determine fish age. Analysis of otoliths is a time-consuming and difficult task that requires the education of human experts. Human age estimates are inconsistent, as several readings by the same human expert might result in different ages assigned to the same otolith, in addition to an inherent bias between readers. To improve efficiency and resolve inconsistent results in the age reading from otolith images by human experts, an automated procedure based on convolutional neural networks (CNNs), a class of deep learning models suitable for image processing, is investigated. We applied CNNs that perform image regression to estimate the age of Greenland halibut (Reinhardtius hippoglossoides) with good results for individual ages as well as the overall age distribution, with an average CV of about 10% relative to the read ages by experts. In addition, the density distribution of predicted ages resembles the density distribution of the ground truth. By using k*l-fold cross-validation, we test all available samples, and we show that the results are rather sensitive to the choice of test set. Finally, we apply explanation techniques to analyze the decision process of deep learning models. In particular, we produce heatmaps indicating which input features that are the most important in the computation of predicted age.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Animals
  • Deep Learning*
  • Flounder*
  • Greenland
  • Humans
  • Neural Networks, Computer
  • Otolithic Membrane

Grants and funding

The internship for IM for writing this paper was funded by the UiT Aurora Centre Program DYNAMO, UiT The Arctic University of Norway. The Department of Mathematics and Statistics (IMS) will cover the publication costs. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.