Comparing meta-analytic moderator estimation techniques under realistic conditions

J Appl Psychol. 2002 Feb;87(1):96-111. doi: 10.1037/0021-9010.87.1.96.

Abstract

One of the most problematic issues in contemporary meta-analysis is the estimation and interpretation of moderating effects. Monte Carlo analyses are developed in this article that compare bivariate correlations, ordinary least squares and weighted least squares (WLS) multiple regression, and hierarchical subgroup (HS) analysis for assessing the influence of continuous moderators under conditions of multicollinearity and skewed distribution of study sample sizes (heteroscedasticity). The results show that only WLS is largely unaffected by multicollinearity and heteroscedasticity, whereas the other techniques are substantially weakened. Of note, HS, one of the most popular methods, typically provides the most inaccurate results, whereas WLS, one of the least popular methods, typically provides the most accurate results.

Publication types

  • Comparative Study

MeSH terms

  • Humans
  • Meta-Analysis as Topic*
  • Models, Theoretical*
  • Monte Carlo Method
  • Psychology, Industrial
  • Reproducibility of Results