Comparison of student pharmacists' performance on in-person vs. virtual OSCEs in a pre-APPE capstone course

Abstract

Introduction: Objective structured clinical examinations (OSCEs,) provided in-person or virtually, assess student pharmacist readiness for advanced pharmacy practice experiences (APPEs). During the COVID-19 pandemic in 2020, it was necessary for many educators to design and implement virtual OSCEs (vOSCEs). Impact on student performance utilizing in-person vs. vOSCE has not been well evaluated. The objective of this study was to determine if a difference existed in student performance when comparing in-person vs. vOSCE in a third year (P3) pharmacy pre-APPE capstone course.

Methods: In winter 2019, four in-person OSCE stations were designed and implemented in a pre-APPE P3 capstone course. In winter 2021, the same four stations were transitioned into vOSCE stations. Assessment (summative) data from similar student cohorts from OSCE 2019 were compared vOSCE 2021 stations using Mann-Whitney U test.

Results: There was no meaningful difference found when comparing student performance on in-person OSCE vs. vOSCE. There was no significant difference for the number of students offered remediation. For most stations, performance improved from formative to summative assessments.

Conclusions: Providing vOSCEs to assess students' skills in a pre-APPE P3 capstone course is a reasonable alternative to in-person OSCEs.

Keywords: Assessment; Objective structured clinical examinations; Standardized patients; Virtual learning.