Item Response Theory Models for Ipsative Tests With Multidimensional Pairwise Comparison Items

Appl Psychol Meas. 2017 Nov;41(8):600-613. doi: 10.1177/0146621617703183. Epub 2017 Apr 9.

Abstract

There is re-emerging interest in adopting forced-choice items to address the issue of response bias in Likert-type items for noncognitive latent traits. Multidimensional pairwise comparison (MPC) items are commonly used forced-choice items. However, few studies have been aimed at developing item response theory models for MPC items owing to the challenges associated with ipsativity. Acknowledging that the absolute scales of latent traits are not identifiable in ipsative tests, this study developed a Rasch ipsative model for MPC items that has desirable measurement properties, yields a single utility value for each statement, and allows for comparing psychological differentiation between and within individuals. The simulation results showed a good parameter recovery for the new model with existing computer programs. This article provides an empirical example of an ipsative test on work style and behaviors.

Keywords: Rasch model; forced-choice items; ipsative data; item response theory; pairwise comparison.