Establishing an Orthopedic Program-Specific, Comprehensive Competency-Based Education Program

J Surg Res. 2021 Mar:259:399-406. doi: 10.1016/j.jss.2020.09.016. Epub 2020 Oct 24.

Abstract

Background: Competency-based education (CBE) seeks to determine resident proficiency in the knowledge, skills, and behaviors required for independent patient care. Multiple assessment instruments evaluate technical skills or direct patient care in the clinic setting, but there are few reports incorporating both within an orthopedic specialty rotation. This study reports a residency program's comprehensive CBE initiative using formative assessments in the clinic and operating room during a sports medicine rotation.

Materials and methods: The sports medicine rotation used validated formative assessments to evaluate resident performance during clinic encounters and program-defined surgical entrustable professional activities (EPAs). Junior resident (postgraduate year [PGY] 1-2) EPAs included basic knee/shoulder arthroscopic procedures. Senior resident (PYG 5) EPAs comprised anterior cruciate ligament reconstruction, biceps tenodesis, shoulder stabilization, and rotator cuff repair. Assessment scores were compared between individuals and PGY groups.

Results: Sixty-six clinical skills (CS) and 106 surgical skills assessments were conducted for 22 residents in one academic year. Surgical skills assessments demonstrated significant differences between each PGY group (P < 0.01). All PGY2 and PGY5 residents achieved independence on the evaluated EPAs. PGY5s earned higher scores in CS assessments than the other classes (P < 0.01). PGY2 residents scored higher than PGY1s in 7 of 9 CS domains. CS independence was achieved by 21 of 22 residents by the end of the rotation.

Conclusions: The CBE program effectively quantified expected differences in resident performance by PGY for clinic and surgical assessments on a sports medicine rotation. Assessments built an environment where feedback was more structured and standardized, creating a culture to improve resident education.

Keywords: Competency-based education; Entrustable professional activities; Orthopedic resident assessment.

MeSH terms

  • Arthroscopy / education*
  • Clinical Competence / statistics & numerical data*
  • Competency-Based Education / methods*
  • Competency-Based Education / statistics & numerical data
  • Curriculum
  • Humans
  • Internship and Residency / methods*
  • Internship and Residency / statistics & numerical data
  • Program Evaluation
  • Sports Medicine / education*