Use of an objective structured clinical examination (OSCE) to assess intern performance in an advanced pharmacy practice experiences (APPE) Ambulatory Care rotation

Ibrahim Sales; Ghada Bawazeer; Mansour Adam Mahmoud; Majidah A Aljohani; Haya M Almalag; Abdulaziz Alhossan; Bashayr Alsuwayni

doi:10.1016/j.jsps.2021.10.006

Use of an objective structured clinical examination (OSCE) to assess intern performance in an advanced pharmacy practice experiences (APPE) Ambulatory Care rotation

Saudi Pharm J. 2021 Dec;29(12):1399-1404. doi: 10.1016/j.jsps.2021.10.006. Epub 2021 Oct 25.

Authors

Ibrahim Sales¹, Ghada Bawazeer¹, Mansour Adam Mahmoud², Majidah A Aljohani³, Haya M Almalag¹, Abdulaziz Alhossan¹, Bashayr Alsuwayni⁴

Affiliations

¹ Department of Clinical Pharmacy, College of Pharmacy, King Saud University, P.O. Box 2454, Riyadh 11451, Saudi Arabia.
² Department of Clinical and Hospital Pharmacy, College of Pharmacy, Taibah University, Mohamed bin Naif Road, Al-Madinah Al-Munawarah, 42353, Saudi Arabia.
³ Pharmaceutical Care Division, King Saud Medical City, Al Imam Turki Ibn Abdullah Ibn Muhammad, Ulaishah, 12746, Riyadh.
⁴ Corporate of Pharmacy Services, King Saud University Medical City, Riyadh, Saudi Arabia.

Abstract

Purpose: Intern assessment during advanced pharmacy practice experiences (APPEs) are generally based upon each individual preceptor's perceptions without an objective measurement of intern understanding and performance. Therefore, we sought to determine whether a pre- and post-OSCE could be used to confirm that interns achieved the goals and objectives of the Ambulatory Care rotation. The aims of this study were to determine whether a pre-rotation OSCE can help pharmacy interns self-assess their clinical strengths and weaknesses and assess whether their knowledge and skills improved after completing a post-rotation OSCE.

Methods: Pharmacy interns undergoing APPE Ambulatory Care rotations from September 2018 to March 2020 participated in a pre- and post-rotation OSCE to assess their knowledge of various chronic disease states. Interns completed pre- and post-OSCE surveys to assess their perceptions about their knowledge and the OSCE experience.

Results: Pharmacy intern knowledge about diabetes, hypertension, dyslipidemia, and atrial fibrillation significantly improved post-OSCE compared to their pre-OSCE scores (p < 0.001). The mean post-OSCE scores for diabetes (p < 0.001), dyslipidemia (P = 0.046), anticoagulation (P = 0.006), and the overall mean post-OSCE scores (P = 0.005) were significantly higher compared to interns' pre-OSCE scores. Students believed that the post-OSCE significantly highlighted their strengths and weaknesses in skills and knowledge compared to the pre-OSCE (P = 0.008).

Conclusion: Pre- and post-APPE OSCE assessments are important tools that can provide interns and preceptors with objective evaluations of student performance. OSCEs can either be used as an alternative to perception-based assessments or integrated into existing preceptor evaluations. Furthermore, OSCEs can help preceptors identify areas that require more emphasis in their rotations.

Keywords: Advanced pharmacy practice experience; Ambulatory care; Chronic disease states; Clinical competency; Competency assessment; Experiential Education; Objective structured clinical examination; Student perception.