Cognitive reflection test: The effects of the items sequence on scores and response time

PLoS One. 2023 Jan 10;18(1):e0279982. doi: 10.1371/journal.pone.0279982. eCollection 2023.

Abstract

This paper aims to expand the literature on the determinants of the Cognitive Reflection Test scores, exploring the effects that the items sequence has on (1) Cognitive Reflection Test scores, (2) response time, (3) the relationship between Cognitive Reflection Test scores and response time, and (4) Cognitive Reflection scores, response time, and the relationship between both variables on men and women. The current study also explored the sex differences on Cognitive Reflection Test and response time according to items sequence. The results showed that manipulating the items sequence, the performance on the Cognitive Reflection Test improved significantly, but the response time were not significantly affected, although the results suggest that first items of the sequence could be working as training items. A positive relationship between Cognitive Reflection Test scores and response time was also found, except when the scores were maximized. Finally, some differences between men and women on the results were also found. The implications of these findings are discussed.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Cognition*
  • Female
  • Humans
  • Male
  • Neuropsychological Tests
  • Reaction Time
  • Sex Characteristics*

Grants and funding

This work was partially supported by the Spanish Ministry of Science and Innovation [grant number PID 2020-116409GB-I00].