Early Evaluation of a New French Surgery Course in the Best Practice of Dealing With Major Incidents and Mass Casualty Events

Abstract

Objective: The main objective of this study is to evaluate the impact of a nationwide 5-month course aimed to prepare surgeons for Major Incidents through the acquisition of key knowledge and competencies. Learners' satisfaction was also measured as a secondary objective.

Design: This course was evaluated thanks to various teaching efficacy metrics, mainly based on Kirkpatrick's hierarchy in medical education. Gain in knowledge of participants was evaluated by multiple-choice tests. Self-reported confidence was measured with 2 detailed pre and post training questionnaires.

Setting: Creation in 2020 of a nationwide, optional and comprehensive Surgical Training in War and Disaster Situation as part of the French surgery residency program. In 2021, data was gathered regarding the impact of the course on participants' knowledge and competencies.

Participants: The study included 26 students in the 2021 cohort (13 residents and 13 practitioners).

Results: Mean scores were significantly higher in the post-test compared to the pre-test, showing significant increase in participants' knowledge during the course: 73,3% vs. 47,3% respectively (p ≤ 0.001). Average learners' confidence scores to perform technical procedures showed at least a +1-point increase on the Likert scale for 65% of items tested (p ≤ 0.001). 89% of items showed at least a +1-point increase on the Likert scale when it came to average learners' confidence score on dealing with complicated situations (p ≤ 0.001). Our post-training satisfaction survey showed that 92% of all participants have noticed the impact of the course on their daily practice.

Conclusion: Our study shows that the third level of Kirkpatrick's hierarchy in medical education was reached. This course therefore appears to be meeting the objectives set by the Ministry of Health. Being only 2 years old, it is on the road to gathering momentum and further development.

Keywords: Mass casualty; damage control; educational measurement; efficacy of training; surgery training; traumatology.