A framework for using real-time evaluative interview feedback for health promotion program and evaluation improvement: The Check It case study

Abstract

Formative evaluation is a crucial strategy for health promotion program improvement. Early and ongoing formative evaluation can make a major impact on program outcomes; however, there are few frameworks that provide actual guidance on how programmatic or research teams can systematically perform this kind of important work. In this article we describe the use of an iterative real-time interview feedback framework we developed for Check It, a community-wide chlamydia screening and treatment program for young African American men in New Orleans, Louisiana. The framework considers the diverse and needed perspectives of multiple stakeholders, including participants, interviewers, transcribers, program staff, and lead researchers and/or administrators. Interviews were conducted with N = 15 Check It participants utilizing this approach. Employing the framework led to critical insights that resulted in several vital programmatic and evaluation improvements. Lessons learned, including strengths and challenges of utilizing the framework, are also shared so that this model can be replicated or adapted by program planning and evaluation professionals for other kinds of programs.

Keywords: Chlamydia; Formative evaluation; Framework; Intervention; Interviews; Sexually transmitted diseases/infections.