The Revised American Occupational Therapy Association Fieldwork Performance Evaluations: Evaluation of Internal Structure, Response Processes, and Precision-Part 2

Anders Kottorp; Catherine Killian; Kathryn Duke; Caniece Leggett; Ruxandra Drasga; Katharine Preissner

doi:10.5014/ajot.2023.050207

The Revised American Occupational Therapy Association Fieldwork Performance Evaluations: Evaluation of Internal Structure, Response Processes, and Precision-Part 2

Am J Occup Ther. 2023 Sep 1;77(5):7705205060. doi: 10.5014/ajot.2023.050207.

Authors

Anders Kottorp¹, Catherine Killian², Kathryn Duke³, Caniece Leggett⁴, Ruxandra Drasga⁵, Katharine Preissner⁶

Affiliations

¹ Anders Kottorp, PhD, OT Reg, is Full Professor and Dean, Faculty of Health and Society, Malmo University, Malmo, Sweden; anders.kottorp@mau.se.
² Catherine Killian, OTD, MEd, OTR/L, is Assistant Professor and Director of Clinical Education, Occupational Therapy Program, Midwestern University, Downers Grove, IL.
³ Kathryn Duke, OTD, OTR/L, is Assistant Professor, Occupational Therapy Programs, West Coast University, Center for Graduate Studies, Los Angeles, CA.
⁴ Caniece Leggett, OTD, OTR/L, is Clinical Outpatient Occupational Therapist, Franciscan Health, Olympia Fields, IL. At the time of this research, Leggett was Research Assistant and Master's Student, Department of Occupational Therapy, College of Applied Health Sciences, University of Illinois at Chicago.
⁵ Ruxandra Drasga, MSOT, MBA, OTR/L, is Occupational Therapist, Community First Medical Center, Chicago, IL. At the time of this research, Drasga was Research Assistant and Master's Student, Department of Occupational Therapy, College of Applied Health Sciences, University of Illinois at Chicago.
⁶ Katharine Preissner, EdD, OTR/L, FAOTA, is Clinical Professor and Academic Fieldwork Coordinator, Department of Occupational Therapy, College of Applied Health Sciences, University of Illinois at Chicago.

PMID: 37851588
DOI: 10.5014/ajot.2023.050207

Abstract

Importance: There is an evidence-based need to assess the validity and reliability/precision of the revised American Occupational Therapy Association's Fieldwork Performance Evaluation (FWPE) items for the occupational therapy student (OTS) and the occupational therapy assistant student (OTAS).

Objective: To evaluate evidence of validity in relation to response processes, internal structure, and precision of the FWPEs.

Design: Cross-sectional study design.

Setting: OTS and OTAS fieldwork practice settings, United States.

Participants: Two hundred sixty-seven fieldwork educators participated in total, providing 228 OTS evaluations and 39 OTAS evaluations.

Outcomes and measures: A Rasch model was used to evaluate aspects of validity and precision.

Results: The rating scales provided evidence of the tools' overall validity. Thirty-two of 37 items on the FWPE for the OTS, and 27 of 31 items on the FWPE for the OTAS demonstrated acceptable fit, but the evidence of unidimensionality in the subscales and in the total scales was not fully supported. The total/reduced FWPE scales were able to separate students into at least four distinct groups of fieldwork performance. The relationships between the current and revised FWPEs indicate that the new scales measure different but related constructs of student fieldwork performance, compared with the current version.

Conclusions and relevance: The findings support that the revised FWPEs for the OTS and OTAS demonstrate preliminary evidence of internal structure, response processes, and precision, supporting evidence-based practice in fieldwork evaluations. What This Article Adds: This article highlights evidence demonstrating the validity and precision of the revised American Occupational Therapy Association's Fieldwork Performance Evaluation items and supports academic and fieldwork settings for occupational therapy students and occupational therapy assistant students.

MeSH terms

Cross-Sectional Studies
Humans
Occupational Therapy* / education
Reproducibility of Results
United States