Uniform presentation of process evaluation results facilitates the evaluation of complex interventions: development of a graph

J Eval Clin Pract. 2015 Feb;21(1):97-102. doi: 10.1111/jep.12252. Epub 2014 Oct 14.

Abstract

Rationale, aims and objectives: Process evaluation is a highly essential element for the increasing number of studies regarding multi-component interventions. Yet, researchers are challenged to collect and present appropriate process outcomes in such way that it is easy and valuable to be used by other researchers and policy makers in interpreting and comparing intervention effects because of the absence of standards for conducting and publishing process evaluation. This article describes the development of a method to concisely summarize the results of process evaluations of complex multi-component interventions.

Methods: Development of a graph with the aim to facilitate the reporting of process evaluation's results, based on a narrative review of the literature for process measures used in complex interventions for elderly people.

Results: Seventeen articles of process evaluations alongside effect studies of complex interventions were reviewed. From these articles, it was found that process evaluations should address whether the intervention (1) was implemented successfully; (2) was evaluated properly; and (3) can be continued in the future. A flow chart based on the essential components of an adequate process evaluation was developed. A simplified but highly informative figure reporting a summary of the results of the process evaluation is proposed and its use is explained by administering the figure to two studies including a process and effect evaluation of a complex intervention.

Conclusion: A graphical approach - which includes the core results of process evaluation and can be used directly in reporting effectiveness studies - will help researchers and policy makers to interpret and compare effects of complex multi-component interventions.

Keywords: complex intervention; evaluation framework; graphical approach; mixed-methods evaluation; outcome and process assessment; process evaluation.

Publication types

  • Research Support, Non-U.S. Gov't
  • Review

MeSH terms

  • Audiovisual Aids*
  • Humans
  • Process Assessment, Health Care / methods*
  • Program Evaluation / methods*
  • Research Design*