Common components analysis: An adapted approach for evaluating programs

Abstract

Common Components Analysis (CCA) summarizes the results of program evaluations that utilize randomized control trials and have demonstrated effectiveness in improving their intended outcome(s) into their key elements. This area of research has integrated and modified the existing CCA approach to provide a means of evaluating components of programs without a solid evidence-base, across a variety of target outcomes. This adapted CCA approach (a) captures a variety of similar program characteristics to increase the quality of the comparison within components; (b) identifies components from four primary areas (i.e., content, process, barrier reduction, and sustainability) within specific programming domains (e.g., vocation, social); and (c) proposes future directions to test the extent to which the common components are associated with changes in intended program outcomes (e.g., employment, job retention). The purpose of this paper is to discuss the feasibility of this adapted CCA approach. To illustrate the utility of this technique, researchers used CCA with two popular employment programs that target successful Veteran reintegration but have limited program evaluation - Hire Heroes USA and Hire Our Heroes. This adapted CCA could be applied to longitudinal research designs to identify all utilized programs and the most promising components of these programs as they relate to changes in outcomes.

Keywords: Common components analysis; Common elements; Common factors; Program evaluation; Separation from military service; Veteran programs; Veteran reintegration.