Rejoinder: Remaining Challenges in Investigating Grade-Retention Effectiveness

Multivariate Behav Res. 2016 Nov-Dec;51(6):877-880. doi: 10.1080/00273171.2016.1229171. Epub 2016 Oct 12.

Abstract

This rejoinder, in response to the commentaries of Steiner, Park, and Kim (this issue) and Reshetnyak, Cham, and Hughes (this issue), discusses remaining challenges in grade retention research. First, a same-age comparison assumes that the instruments used in different grades measure ability equally well. We discuss the importance of evaluating the properties of the scaling process to address whether this assumption has been met. Second, we discuss issues in the selection of covariates to be included in the weights. Third, we discuss the unconfoundedness assumption and the problem of remaining imbalance. Finally, we provide an empirical illustration showing that studying grade-retention effectiveness comes with multiple methodological decisions that are rooted in a bias-variance trade-off.

Keywords: Bias–variance trade-off; grade retention; marginal structural models; unconfoundedness assumption.