Developing a Comprehensive First-year Capstone to Assess and Inform Student Learning and Curriculum Effectiveness

Am J Pharm Educ. 2019 Jun;83(5):6730. doi: 10.5688/ajpe6730.

Abstract

Objective. To describe the development and implementation of an innovative, comprehensive, multi-day module focused on assessing and providing feedback on student cognitive and interpersonal skill development and practice readiness after the first year (PY1) of a Doctor of Pharmacy (PharmD) curriculum. Methods. A multi-day capstone assessment was developed to evaluate first-year students' knowledge of course content, ability to find and apply information, and interpersonal skills, including teamwork and adaptability. The PY1 Capstone consisted of four parts. Knowledge was assessed using 130 multiple-choice items on first-year course content and 50 fill-in-the-blank items on Top 200 brand and generic drug names. The ability to find and apply information was assessed using a 45-question open-book test. Interpersonal skills were assessed using a specially designed multiple mini-interview (MMI). The final part of the assessment was a debriefing session that provided rapid-cycle feedback on capstone performance and a bridge between students' recently completed first-year coursework and an upcoming 2-month experiential immersion. Results. The average score on the closed-book and open-book assessments were 75% and 68%, respectively. Most students displayed satisfactory interpersonal skills based on the MMI. Students viewed the assessment positively based on post-assessment survey responses (>75%). Most students (98%) reported not studying for the assessment, indicating that the results should reflect students' retention of knowledge and skills. Conclusion. The capstone assesses students on knowledge and skills and provides students with feedback on areas to focus on during their early immersion. Continued work is needed to ensure the process is transparent and cost-effective.

Keywords: assessment; capstone; formative assessment; interpersonal skills; multiple mini-interview.

MeSH terms

  • Curriculum / standards*
  • Education, Pharmacy / methods*
  • Education, Pharmacy / organization & administration
  • Education, Pharmacy / standards
  • Education, Pharmacy / trends
  • Educational Measurement / methods*
  • Educational Measurement / standards*
  • Feedback
  • Female
  • Formative Feedback
  • Humans
  • Male
  • Program Development
  • Social Skills
  • Students, Pharmacy