Viability of Virtual Skills-based Assessments Focused on Communication

Abstract

Objective To evaluate faculty and student perceptions of and performance on virtual skills-based assessments focused on communication compared to in-person assessments.Methods In spring 2020, virtual skills-based assessments were conducted. After all assessments were completed, two 12-item questionnaires, one for students and one for the faculty members who conducted the assessment, were designed to assess perceptions of virtual skills-based assessments. The surveys were distributed via an online platform to second- and third-year (P2 and P3) pharmacy students and to faculty who had participated in a virtual skills-based assessment. Scores from the spring 2020 virtual skills-based assessment were compared to scores on the in-person skills-based assessment that took place in spring 2019.Results Of the 19 faculty and 279 students invited to participate, 18 (94.7%) faculty and 241 (86.4%) students responded. The majority of faculty (88.9%) and students (63.5%) perceived the virtual skills-based assessments to be effective at simulating an interaction. However, only 33.3% of faculty and 28.6% of students preferred the virtual environment. There was not a significant difference in student performance between in-person and virtual assessments for patient consultation and SOAP note skills.Conclusion Providing sufficient formative and summative feedback to pharmacy students is a challenge, particularly in the context of skills-based assessments. Students and faculty reported that the virtual assessment provided an opportunity for an appropriate assessment of student communication skills. However, a strong preference for using virtual skills-based assessments in the future was not observed.

Keywords: assessment; communication skills; skills lab; skills-based assessment; virtual assessment.