The Application of Kirkpatrick's Evaluation Model in the Assessment of Interprofessional Simulation Activities Involving Pharmacy Students: A Systematic Review

Abstract

Objectives: To our knowledge, this systematic review is the first to assess pharmacy-involved interprofessional education (IPE) simulation activities in establishing current methodological effectiveness using Kirkpatrick's Evaluation Model. This is a training evaluative model that assesses educational training activities according to 4 levels: reaction, learning, behavior, and results.

Findings: From the 3108 studies retrieved, 14 studies met the inclusion criteria. Thirteen studies achieved levels 1 and 2 of Kirkpatrick's Evaluation Model, and 1 achieved level 3. One study only achieved level 1. Single-group, pre- and posttest studies were the most common study designs (n = 9), and 1 study followed a longitudinal approach. IPE duration ranged from 45 min to 5 days, and most of the studies were conducted in the United States (n = 10). Most studies alluded to an underpinning theory behind IPE simulation design and chose surveys as their mode of data collection.

Summary: The most common limitation reported was the uneven representation of professions and a lack of data on the studies' effect in practice. To demonstrate the achievement of outcomes in relation to levels 3 and 4, there is a need for longitudinal studies of IPE simulation activities. Although evaluative studies showed a positive response to IPE simulation at a basic level, there is a lack of effective integration of theory behind IPE design. Future studies need to consider this when setting the infrastructure of IPE design, as well as making efforts to mobilize stakeholders in the workplace to help facilitate transfer of learning.

Keywords: Collaborative practice; Health education; Interprofessional collaboration; Interprofessional education; Kirkpatrick’s evaluation model.