Surgical resident technical skill self-evaluation: increased precision with training progression

Abstract

Background: Surgical resident ability to accurately evaluate one's own skill level is an important part of educational growth. We aimed to determine if differences exist between self and observer technical skill evaluation of surgical residents performing a single procedure.

Materials and methods: We prospectively enrolled 14 categorical general surgery residents (six post-graduate year [PGY] 1-2, three PGY 3, and five PGY 4-5). Over a 6-month period, following each laparoscopic cholecystectomy, residents and seven faculty each completed the Objective Structured Assessment of Technical Skills (OSATS). Spearman's coefficient was calculated for three groups: senior (PGY 4-5), PGY3, and junior (PGY 1-2). Rho (ρ) values greater than 0.8 were considered well correlated.

Results: Of the 125 paired assessments (resident-faculty each evaluating the same case), 58 were completed for senior residents, 54 for PGY3 residents, and 13 for junior residents. Using the mean from all OSATS categories, trainee self-evaluations correlated well to faculty (senior ρ 0.97, PGY3 ρ 0.9, junior ρ 0.9). When specific OSATS categories were analyzed, junior residents exhibited poor correlation in categories of respect for tissue (ρ -0.5), instrument handling (ρ 0.71), operative flow (ρ 0.41), use of assistants (ρ 0.05), procedural knowledge (ρ 0.32), and overall comfort with the procedure (ρ 0.73). PGY3 residents lacked correlation in two OSATS categories, operative flow (ρ 0.7) and procedural knowledge (ρ 0.2). Senior resident self-evaluations exhibited strong correlations to observers in all areas.

Conclusions: Surgical residents improve technical skill self-awareness with progressive training. Less-experienced trainees have a tendency to over-or-underestimate technical skill.

Keywords: Evaluation; Laparoscopic; Resident; Surgical education; Technical skill.