Semi-automated Rasch analysis with differential item functioning

Behav Res Methods. 2023 Sep;55(6):3129-3148. doi: 10.3758/s13428-022-01947-9. Epub 2022 Sep 7.

Abstract

Rasch analysis is a procedure to develop and validate instruments that aim to measure a person's traits. However, manual Rasch analysis is a complex and time-consuming task, even more so when the possibility of differential item functioning (DIF) is taken into consideration. Furthermore, manual Rasch analysis by construction relies on a modeler's subjective choices. As an alternative approach, we introduce a semi-automated procedure that is based on the optimization of a new criterion, called in-plus-out-of-questionnaire log likelihood with differential item functioning (IPOQ-LL-DIF), which extends our previous criterion. We illustrate our procedure on artificially generated data as well as on several real-world datasets containing potential DIF items. On these real-world datasets, our procedure found instruments with similar clinimetric properties as those suggested by experts through manual analyses.

Keywords: DIF detection; Differential item functioning; GPCM-DIF; GPCMlasso; Generalized partial credit model; Penalized JMLE; Rasch model; Semi-automated Rasch analysis.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Humans
  • Probability
  • Psychometrics* / methods
  • Reproducibility of Results
  • Surveys and Questionnaires