Context matters: Using mixed methods timelines to provide an accessible and integrated visual for complex program evaluation data

Anna Newton-Levinson; Megan Higdon; Jessica Sales; Laurie Gaydos; Roger Rochat

doi:10.1016/j.evalprogplan.2020.101784

Context matters: Using mixed methods timelines to provide an accessible and integrated visual for complex program evaluation data

Eval Program Plann. 2020 Jan 22:80:101784. doi: 10.1016/j.evalprogplan.2020.101784. Online ahead of print.

Authors

Anna Newton-Levinson¹, Megan Higdon², Jessica Sales³, Laurie Gaydos⁴, Roger Rochat⁵

Affiliations

¹ Department of Behavioral Sciences and Health Education, Rollins School of Public Health, Emory University, United States. Electronic address: anewto3@emory.edu.
² Department of Behavioral Sciences and Health Education, Rollins School of Public Health, Emory University, United States. Electronic address: megan.higdon@emory.edu.
³ Department of Behavioral Sciences and Health Education, Rollins School of Public Health, Emory University, United States. Electronic address: jmcderm@emory.edu.
⁴ Department of Health Policy and Management, Rollins School of Public Health, Emory University, United States. Electronic address: lgaydos@emory.edu.
⁵ Hubert Department of Global Health, Rollins School of Public Health, Emory University, United States. Electronic address: rrochat@emory.edu.

PMID: 32045750
DOI: 10.1016/j.evalprogplan.2020.101784

Abstract

The need for conducting evaluations which reflect of the influence of context on complex programs is increasingly recognized in the field of evaluation. Better data visualization techniques for connecting context with program evaluation data are needed. We share our experience developing a mixed methods timeline to visualize complexity and context with evaluation data. Mixed methods timelines provide a meaningful way to show change over time in both a visually stimulating and accessible format for evaluation audiences. This paper provides an innovative example of using mixed methods timelines to integrate evaluation data with key program activities and milestones, while also showing internal and external contextual influences in one cohesive visual. We present methods and best practices for collecting contextual data and for incorporating a variety of data sources into such a visual. We discuss several strategies to collect and organize context related data including: qualitative interviews, program materials, narrative reports, and member checking with stakeholders and staff. Gathering multiple perspectives is essential to better capture the multi-layered elements of program activities and context.

Keywords: Complex evaluation; Context; Data visualization; Evaluation reporting; Mixed methods; Timeline.