Using the Entrustable Professional Activities Framework in the Assessment of Procedural Skills

J Grad Med Educ. 2017 Apr;9(2):209-214. doi: 10.4300/JGME-D-16-00282.1.

Abstract

Background: The entrustable professional activity (EPA) framework has been identified as a useful approach to assessment in competency-based education. To apply an EPA framework for assessment, essential skills necessary for entrustment to occur must first be identified.

Objective: Using an EPA framework, our study sought to (1) define the essential skills required for entrustment for 7 bedside procedures expected of graduates of Canadian internal medicine (IM) residency programs, and (2) develop rubrics for the assessment of these procedural skills.

Methods: An initial list of essential skills was defined for each procedural EPA by focus groups of experts at 4 academic centers using the nominal group technique. These lists were subsequently vetted by representatives from all Canadian IM training programs through a web-based survey. Consensus (more than 80% agreement) about inclusion of each item was sought using a modified Delphi exercise. Qualitative survey data were analyzed using a framework approach to inform final assessment rubrics for each procedure.

Results: Initial lists of essential skills for procedural EPAs ranged from 10 to 24 items. A total of 111 experts completed the national survey. After 2 iterations, consensus was reached on all items. Following qualitative analysis, final rubrics were created, which included 6 to 10 items per procedure.

Conclusions: These EPA-based assessment rubrics represent a national consensus by Canadian IM clinician educators. They provide a practical guide for the assessment of procedural skills in a competency-based education model, and a robust foundation for future research on their implementation and evaluation.

MeSH terms

  • Canada
  • Clinical Competence*
  • Competency-Based Education*
  • Consensus
  • Educational Measurement*
  • Focus Groups
  • Humans
  • Internal Medicine / education*
  • Internship and Residency*
  • Program Development
  • Program Evaluation