A Comment on Test Validation: The Importance of the Clinical Perspective

Am J Speech Lang Pathol. 2019 Feb 21;28(1):204-210. doi: 10.1044/2018_AJSLP-18-0048.

Abstract

Purpose The misuse of standardized assessments has been a long-standing concern in speech-language pathology and traditionally viewed as an issue of clinician competency and training. The purpose of this article is to consider the contribution of communication breakdowns between test developers and the end users to this issue. Method We considered the misuse of standardized assessments through the lens of the 2-communities theory, in which standardized tests are viewed as a product developed in 1 community (researchers/test developers) to be used by another community (frontline clinicians). Under this view, optimal test development involves a conversation to which both parties bring unique expertise and perspectives. Results Consideration of the interpretations that standardized tests are typically validated to support revealed a mismatch between these and the interpretations and decisions that speech-language pathologists typically need to make. Test development using classical test theory, which underpins many of the tests in our field, contributes to this mismatch. Application of item response theory could better equip clinicians with the psychometric evidence to support the interpretations they desire but is not commonly found in the standardized tests used by speech-language pathologists. Conclusions Advocacy and insistence on the consideration of clinical perspectives and decision making in the test validation process is a necessary part of our role. In improving the nature of the statistical evidence reported in standardized assessments, we can ensure these tools are appropriate to fulfill our professional obligations in a clinically feasible way.

MeSH terms

  • Clinical Competence
  • Data Interpretation, Statistical
  • Evidence-Based Practice / methods
  • Evidence-Based Practice / standards
  • Humans
  • Interprofessional Relations
  • Language Tests / standards*
  • Psychometrics
  • Reproducibility of Results
  • Research Report / standards
  • Speech Production Measurement / standards*
  • Speech-Language Pathology / standards*
  • Translational Research, Biomedical / standards