Introduction: The Stryker Surgical Simulator is a hybrid, temporal bone simulator that uses both tactile and haptic feedback combined with a computer interface. We sought to validate this simulator as an otolaryngology resident training tool for performing tympanomastoidectomy.
Materials and methods: 15 residents and staff performed five basic cortical mastoidectomies. Staff surgeons comprised the "expert" cohort and resident surgeons comprised the "trainee" cohort. Subjective evaluation of the face validity and content validity was assessed via pre- and postquestionnaires. Objective evaluation of content validity was assessed through grading of each temporal bone dissection specimen, comparing time to task completion, and calculating the rate of injury to critical structures. Study approved by the Institutional Review Board (2013.0001).
Results: Post hoc questionnaires showed that both staff and residents subjectively rated the simulator favorably on face validity, content validity, and all global assessment categories, though there were no significant distinctions between groups (P > 0.05). The resident group had a significantly longer drilling time compared with the staff group throughout the series of tympanomastoidectomies (P = 0.008), and both groups showed a decrease in time to task completion with repetitive drilling. However, there were no significant differences in surgical performance as evaluated by a blinded senior neurotologist (P = 0.52). There were also no critical injuries recorded by the simulator in any of the 75 trials, preventing any evaluation on this measure.
Conclusions: Despite favorable subjective evaluations by both staff and residents, objective discrimination between experienced and novice participants was not achieved. This was likely in part due to inherent design flaws of the simulator. This emphasizes the potential shortcomings of surgical simulation models for highly technical procedures and points to the importance of intensive study and validation prior to incorporation of commercial training models into surgical training programs.
Published by Oxford University Press on behalf of the Association of Military Surgeons of the United States 2020. This work is written by US Government employees and is in the public domain in the US.