Objective: The aim of this study was to test simulator validity to evaluate the ability of anaesthesia residents to solve two simulated scenarios.
Study design: Monocentre, prospective, randomized study.
Population: Anaesthesia residents.
Methods: All anaesthesia residents were invited to participate into the study but were free to decline to take part. The authors developed grading forms to evaluate preoperative preparation of anaesthesia room and two simulated scenarios which had been previously validated. All residents were evaluated on the preoperative preparation of anaesthesia room. A randomization was performed to select half of the residents to be tested on one of the simulated scenario. Two experienced anaesthesiologists scored the residents' performance. At the end of the simulated session, residents rated the realism of the scenarios.
Results: Among 72 training residents in our institution, 48 participated with 24 beginning and 24 advanced residents. Median scores were similar between beginning (first and second year) and advanced residenced (third and fourth year) for the preoperative preparation of anaesthesia room (17 vs 17 for a maximal score of 25) while scores tended to be higher in advanced residents for simulated scenarios (scenario 1 [34 vs 19 for a maximal score of 55; p = 0.0009], scenario 2 [17 vs 13 for a maximal score of 45; p = 0.58]). However, numerous management errors were observed and some of them did not improve with training. Anaesthesia residents rated the simulator scenarios as realistic.
Conclusion: This study suggests that mannequin-based simulator appears as a reliable and valid tool to test the performance of anaesthesia residents during critical situations.