A new scale for the evaluation of clinical practice guidelines applicability: development and appraisal

Implement Sci. 2018 Apr 25;13(1):61. doi: 10.1186/s13012-018-0746-5.

Abstract

Background: This study aimed to develop the clinical practice guidelines applicability evaluation (CPGAE-V1.0) scale and to evaluate its validity and reliability.

Methods: One hundred fifty assessors were invited to rate two rounds of importance scoring of the applicability indicators by using the 5-point Likert scale. Approved indicators formed the CPGAE-V1.0 scale, consisting of 19 items, arranged into 4 domains. We enrolled eligible clinicians from 8 institutions to evaluate 9 clinical practice guidelines using the CPGAE-V1.0 scale. Content validity, construct validity, internal reliability, intra-rater reliability, and responsiveness were analyzed.

Results: A total of 220 clinicians participated, and the response rate was 98.6% (217/220). The CPGAE-V1.0 scale had favorable content validity. The four-factor model produced acceptable fit indices. The scale had an excellent internal consistency and item discrimination. It could identify the degree of applicability of the different dimensions between different guidelines. In all domains, 77.8% (7/9) of CPGs in the minimum-scoring domain were concentrated in the "coordination of support" domain.

Conclusions: The CPGAE-V1.0 scale is a valid and reliable instrument for measuring the applicability of CPG.

Keywords: Applicability; Clinical practice guideline (CPG); Scale evaluation.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Evidence-Based Medicine / standards*
  • Health Services Research / methods
  • Humans
  • Physicians
  • Practice Guidelines as Topic / standards*
  • Practice Patterns, Physicians' / standards*
  • Program Development
  • Program Evaluation
  • Psychometrics / instrumentation
  • Quality Indicators, Health Care*
  • Reproducibility of Results
  • Surveys and Questionnaires / standards*