Measuring individual differences in cognitive abilities in the lab and on the web

PLoS One. 2019 Dec 11;14(12):e0226217. doi: 10.1371/journal.pone.0226217. eCollection 2019.

Abstract

The present study compared lab-based and web-based versions of cognitive individual difference measures widely used in second language research (working memory and declarative memory). Our objective was to validate web-based versions of these tests for future research and to make these measures available for the wider second language research community, thus contributing to the study of individual differences in language learning. The establishment of measurement equivalence of the two administration modes is important because web-based testing allows researchers to address methodological challenges such as restricted population sampling, low statistical power, and small sample sizes. Our results indicate that the lab-based and web-based versions of the tests were equivalent, i.e., scores of the two test modes correlated. The strength of the relationships, however, varied as a function of the kind of measure, with equivalence appearing to be stronger in both the working memory and the verbal declarative memory tests, and less so in the nonverbal declarative memory test. Overall, the study provides evidence that web-based testing of cognitive abilities can produce similar performance scores as in the lab.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Cognition / physiology*
  • Female
  • Humans
  • Internet
  • Linear Models
  • Male
  • Memory and Learning Tests*
  • Memory, Short-Term
  • Reproducibility of Results
  • Young Adult

Grants and funding

Our research was supported by the LEAD Graduate School and Research Network (grant DFG-GSC1028), a project of the Excellence Initiative of the German federal and state governments. We also acknowledge support by Deutsche Forschungsgemeinschaft and Open Access Publishing Fund of University of Tübingen. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.