Understanding and tackling the reproducibility crisis - Why we need to study scientists' trust in data

Abstract

In the life sciences, there is an ongoing discussion about a perceived 'reproducibility crisis'. However, it remains unclear to which extent the perceived lack of reproducibility is the consequence of issues that can be tackled and to which extent it may be the consequence of unrealistic expectations of the technical level of reproducibility. Large-scale, multi-institutional experimental replication studies are very cost- and time-intensive. This Perspective suggests an alternative, complementary approach: meta-research using sociological and philosophical methodologies to examine researcher trust in data. An improved understanding of the criteria used by researchers to judge data reliability will provide crucial, initial evidence on the actual scale of the reproducibility crisis and on measures to tackle it.