Development and validation of a performance-based palliative care assessment tool for student pharmacists

Abstract

Introduction: Integration of hospice and palliative care principles within pharmacy curricula is essential to fill the need of pharmacist training in this growing specialty. A formalized assessment tool to evaluate skill development does not exist for student pharmacists specific to palliative care. The objective of this study was to develop a valid and reliable, palliative care-focused, performance-based assessment tool for student pharmacists.

Methods: Eight academic palliative care (PC) pharmacists were recruited for the workgroup to perform domain development, validation, tool creation, and reliability testing for this performance-based assessment tool. Hospice and palliative care clinical pharmacist entrustable professional activities (EPAs) served as the framework. Content validity testing utilized content validity index and scale universal agreement (S-CVI/UA) to determine level of agreement for activities included in the tool. Student volunteers completed a standardized patient case and workgroup members served as raters during the reliability testing phase. Interrater reliability was measured through calculation of Fleiss Kappa scores for each activity.

Results: Out of 14 EPAs, nine were deemed "essential" to include in the tool. Thirty-four supporting activities for the nine essential EPAs were drafted. Two rounds of content validity testing were necessary to achieve S-CVI/UA of 0.9593. Consensus was reached from workgroup members for activities deemed necessary to include in the tool after questionnaire distribution utilizing a Fleiss Kappa cutoff >0.6.

Conclusions: This validated tool will afford colleges and schools of pharmacy with PC curricula an opportunity to assess student achievement of PC-specific skills and evaluate curricular effectiveness.

Keywords: Palliative care education; Performance-based assessment; Student pharmacists.