Ignoring imperfect detection in biological surveys is dangerous: a response to 'fitting and interpreting occupancy models'

PLoS One. 2014 Jul 30;9(7):e99571. doi: 10.1371/journal.pone.0099571. eCollection 2014.

Abstract

In a recent paper, Welsh, Lindenmayer and Donnelly (WLD) question the usefulness of models that estimate species occupancy while accounting for detectability. WLD claim that these models are difficult to fit and argue that disregarding detectability can be better than trying to adjust for it. We think that this conclusion and subsequent recommendations are not well founded and may negatively impact the quality of statistical inference in ecology and related management decisions. Here we respond to WLD's claims, evaluating in detail their arguments, using simulations and/or theory to support our points. In particular, WLD argue that both disregarding and accounting for imperfect detection lead to the same estimator performance regardless of sample size when detectability is a function of abundance. We show that this, the key result of their paper, only holds for cases of extreme heterogeneity like the single scenario they considered. Our results illustrate the dangers of disregarding imperfect detection. When ignored, occupancy and detection are confounded: the same naïve occupancy estimates can be obtained for very different true levels of occupancy so the size of the bias is unknowable. Hierarchical occupancy models separate occupancy and detection, and imprecise estimates simply indicate that more data are required for robust inference about the system in question. As for any statistical method, when underlying assumptions of simple hierarchical models are violated, their reliability is reduced. Resorting in those instances where hierarchical occupancy models do no perform well to the naïve occupancy estimator does not provide a satisfactory solution. The aim should instead be to achieve better estimation, by minimizing the effect of these issues during design, data collection and analysis, ensuring that the right amount of data is collected and model assumptions are met, considering model extensions where appropriate.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Computer Simulation
  • Ecology / methods*
  • Models, Biological*
  • Models, Statistical

Grants and funding

This work was supported by the Australian Research Council (ARC) Centre of Excellence for Environmental Decisions (www.ceed.edu.au), the National Environment Research Program (NERP) Decisions Hub (www.nerpdecisions.edu.au), and ARC Future Fellowships to MM and BW. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.