Psychometrics Anonymous: Does a Transparent Data Sharing Policy Affect Data Collection?

Psychol Belg. 2019 Sep 19;59(1):373-392. doi: 10.5334/pb.503.

Abstract

As researchers, we are advised to share our data to improve transparency and increase the reproducibility of experiments. Simultaneously, making data freely accessible can raise ethical questions regarding the participants' privacy. We first outline the challenges regarding "open data" for researchers in light of the GDPR. Then, we turn to the impact of an open-access data sharing policy on the participants: could the participants' knowledge about the future use of the data alter the data itself? Through two pre-registered studies (N = 193, collected on campus and N = 543, online participation), we investigate whether disclosing that anonymized data will be publicly shared vs. not shared influences a potential participants' intention to take part in the study. Using both frequentist and Bayesian analysis, we conclude towards an absence of effect of a difference in data sharing policy on scores in the Big Five questionnaire and social desirability, careless response behavior, and results in the anchoring paradigm. In the second study, a lexicometric analysis of participants' reactions to openly sharing data reveals a readiness to share data and support transparency under the condition of preserved anonymity. Hence, if anonymity can be ensured, there seems to be no methodological or ethical drawback in transparent and open data sharing policies for many psychological studies.

Keywords: GDPR; anonymity; data accessibility; methods; open science; privacy; psychology.

Publication types

  • Review

Grants and funding

This project was supported by the F.R.S.-FNRS through a grant “aspirant.e F.R.S.-FNRS” to Julia Eberlen. We want to thank Elisa Coen for her support in preparing the testing material and the students participating in the research seminar for their help with data collection.