The Revised 2017 MSPE: Better, But Not "Outstanding"

Abstract

Aim: The medical student performance evaluation (MSPE) is relied on as an objective summary evaluation by surgical program directors. In 2017, an MSPE task force released recommendations for best practice for their format and content. The purpose of this study was to analyze US medical schools' adherence to these guidelines.

Methods: MSPEs from 113 of 147 Liaison committee on Medical Education (LCME)-accredited medical schools were analyzed for measurable attributes such as word counts, transparent clerkship grading, comparative performance data, and statements of professionalism. 2017 MSPEs were compared to a baseline group of 45 MSPEs from 2016 to measure change over time. Measurable attributes were compared using the Fisher exact and Mann Whitney-U tests. A p value < 0.05 was deemed statistically significant.

Results: We analyzed 113 MSPEs from 2017. The median page count decreased by one from the prior year, with a narrower range of variation. 96% of schools reported a discreet grade in surgery. We observed substantial compliance with the recommendation for a statement of professionalism, noteworthy characteristics, and comparative clerkship data. More schools were observed to report school-wide rankings. There were significant variations in the graphical depiction of student achievement.

Conclusions: In response to the 2017 task force guidelines, MSPEs have become more standardized and transparent with regard to medical student evaluation. There is increased (but not ubiquitous) adherence with the recommendation for three noteworthy characteristics and statements of professionalism. Of particular importance to surgical program directors, 95.6% of 2017 MSPEs report a grade in the surgical clerkship and 85.8% include school-wide comparative clerkship performance data. Still, only 69.9% currently report school-wide summative performance data.

Keywords: Dean's Letter; Interpersonal and Communication Skills; MSPE; MSPE Task Force; Professionalism; Surgery Residency.