Background: Assessing implementation fidelity is highly recommended, but successful approaches can be challenging. Family Planning Elevated (FPE) is a statewide contraceptive initiative which partnered with 28 health clinics across Utah. To assess implementation fidelity, we developed in-situ high-fidelity simulation training to both determine clinic adherence to FPE and offer education to implementing teams. This study aimed to develop, pilot, and assess the use of simulation as a tool for measuring implementation fidelity.
Methods: We developed two simulation scenarios to determine implementation fidelity: one scenario wherein a client is seeking a new method of contraception and another in which the same client has returned to discontinue the method. Both simulations contained multiple aspects of program implementation (e.g., determining program eligibility). We then offered simulations to all FPE partner organizations. To assess simulation training as a tool for determining implementation fidelity, we developed strategies aligned with each aspect of an adapted RE-AIM framework, including pre-post surveys, acceptability and self-efficacy testing, a checklist for programmatic adherence, field notes, action planning and analysis of monitoring data.
Results: Fifteen clinical sites and 71 team members participated in the in-situ simulations. Assessment of the checklist showed that 90% of the clinics successfully demonstrated key program components, including person-centered counseling techniques such as sitting at the patient's level (95.8%); asking open-ended questions (100%); and explaining how to use the contraceptive method selected (91.7%). More than half of clinics fell short in programmatic areas including: confirmation that the FPE program covered same-day intrauterine device insertion (54.2%), and education on health risks associated with the selected contraceptive method (58.3%). After simulation, participants reported improved knowledge of how FPE works (p = < 0.001), increased ability to identify FPE-eligible clients (p = 0.02) and heightened self-efficacy in helping clients select a method (p = 0.03). Participants were satisfied with the simulations, with most (84.1%) reporting that the simulation exceeded their expectations.
Conclusions: Highly-realistic in-situ family planning simulations are acceptable to participants, positively change knowledge and clinical team confidence, and can identify systems gaps in clinical care and program implementation. Simulation offers a reciprocal way of monitoring implementation fidelity of a family planning access initiative.
Trial registration: This project was determined to be exempt by the IRB of the University of Utah, the larger Family Planning Elevated program under which this pilot study was nested is registered at ClinicalTrials.gov Identifier: NCT03877757 .
Keywords: Clinic audits; Family Planning; Implementation fidelity; Simulation.
© 2022. The Author(s).