Backward mapping from outcomes: Using a realist evaluation lens to evaluate an international aid program

Abstract

In this paper, a backward mapping approach to realist evaluation is used to evaluate the efficacy of an international inclusive education short course program in transforming inclusive perspectives and practices of educators from Nepal who were considered leaders in inclusive education. The program, an Australia Awards South and West Asia (AASWA) short course, delivered by an Australian university, was designed to build on the existing capacity of the participants to lead the implementation of inclusive education reforms and system enhancements within the school system in Nepal. Data collected before, during and after the program provide insights into the ways in which participants responded to the program. Our findings indicate that a deep understanding of context is needed by program planners to identify how and why particular mechanisms are triggered that lead to transformative learning of the participants. We suggest that backward mapping as a methodology is a viable realist evaluation process to evaluate complex programs such as the short-term international aid program on IE. Our paper concludes with recommendations for developers of similar programs in the future.

Keywords: Backward mapping; Context; Inclusive education; International aid; Mechanism; Nepal; Realist evaluation.