While integrative data analysis (IDA) presents great opportunity, it also necessitates a myriad of methodological decisions related to harmonizing disparate measures collected across multiple studies. There is a lack of step-by-step methodological guidance for harmonizing disparate measures of latent constructs differently conceptualized or operationalized across studies, such as social, emotional, and behavioral constructs often utilized in prevention science. The current paper addressed this gap by providing methodological guidance and a case illustration focused on harmonizing measures of disparately conceptualized and operationalized constructs. We do so by outlining a five-phased harmonization approach paired with an illustrative example of the approach as applied to harmonization of broadband latent emotional and behavioral health constructs assessed with different measures across studies. This approach builds on and expands upon procedures currently recommended in the IDA literature with parallels to best practices in test development procedures. The illustrative example of our phased approach is drawn from an IDA study of 11 randomized controlled trials of Coping Power (Lochman & Wells, 2004), an evidence-based preventive intervention. We demonstrate the harmonization of two constructs, internalizing and externalizing problems, as harmonized across the teacher-reported scales of the Achenbach System of Empirically Based Assessment (Achenbach, 1991a) and the Behavior Assessment System for Children (Reynolds & Kamphaus, 2004). Finally, we consider the potential strengths and limitations of this phased approach, underscoring areas for future methodological research and conclude with some recommendations.
Keywords: Assessment; Harmonization; Integrative data analysis; Measurement; Randomized controlled trials.
© 2023. Society for Prevention Research.