Purpose: To evaluate the EyeSi(™) simulator in regard to assessing competence in cataract surgery. The primary objective was to explore all simulator metrics to establish a proficiency-based test with solid evidence. The secondary objective was to evaluate whether the skill assessment was specific to cataract surgery.
Methods: We included 26 ophthalmic trainees (no cataract surgery experience), 11 experienced cataract surgeons (>4000 cataract procedures) and five vitreoretinal surgeons. All subjects completed 13 different modules twice. Simulator metrics were used for the assessments.
Results: Total module score on seven of 13 modules showed significant discriminative ability between the novices and experienced cataract surgeons. The intermodule reliability coefficient was 0.76 (p < 0.001). A pass/fail level was defined from the total score on these seven modules using the contrasting-groups method. The test had an overall ability to discriminate between novices and experienced cataract surgeons, as 21 of 26 novices (81%) versus one of 11 experienced surgeons (9%) did not pass the test. The vitreoretinal surgeons scored significantly higher than the novices (p = 0.006), but not significantly lower than the experienced cataract surgeons (p = 0.32).
Conclusion: We have established a performance test, consisting of seven modules on the EyeSi(™) simulator, which possess evidence of validity. The test is a useful and reliable tool for assessment of both cataract surgical and general microsurgical skills in vitro.
Keywords: assessment; cataract surgery; proficiency-based training; standard setting; virtual reality simulation.
© 2015 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.