Bias and Precision of Continuous Norms Obtained Using Quantile Regression

Assessment. 2021 Sep;28(6):1735-1750. doi: 10.1177/1073191120910201. Epub 2020 Jun 2.

Abstract

Continuous norming is an increasingly popular approach to establish norms when the performance on a test is dependent on age. However, current continuous norming methods rely on a number of assumptions that are quite restrictive and may introduce bias. In this study, quantile regression was introduced as more flexible alternative. Bias and precision of quantile regression-based norming were investigated with (age-)group as covariate, varying sample sizes and score distributions, and compared with bias and precision of two other norming methods: traditional norming and mean regression-based norming. Simulations showed the norms obtained using quantile regression to be most precise in almost all conditions. Norms were nevertheless biased when the score distributions reflected a ceiling effect. Quantile regression-based norming can thus be considered a promising alternative to traditional norming and mean regression-based norming, but only if the shape of the score distribution can be expected to be close to normal.

Keywords: bias; continuous norming; precision; quantile regression; regression-based norming.

MeSH terms

  • Bias
  • Humans
  • Regression Analysis*
  • Sample Size