Quality assessment of Japanese clinical practice guidelines including recommendations for acupuncture

Yuse Okawa; Hitoshi Yamashita; Shoko Masuyama; Yohji Fukazawa; Ikuro Wakayama

doi:10.1016/j.imr.2022.100838

Quality assessment of Japanese clinical practice guidelines including recommendations for acupuncture

Integr Med Res. 2022 Sep;11(3):100838. doi: 10.1016/j.imr.2022.100838. Epub 2022 Feb 11.

Authors

Yuse Okawa¹, Hitoshi Yamashita¹, Shoko Masuyama¹, Yohji Fukazawa², Ikuro Wakayama²

Affiliations

¹ Graduate School of Health Sciences, Morinomiya University of Medical Sciences, Osaka, Japan.
² Faculty of Health Sciences, Kansai University of Health Sciences, Osaka, Japan.

Abstract

Background: The quality of clinical practice guidelines (CPGs) should be extensively evaluated. This study aimed to evaluate Japanese CPGs that include recommendations for acupuncture.

Methods: In a literature search, CPGs including recommendations for acupuncture published in Japan until October 2021 were sought. We assessed (1) whether the CPGs were developed in accordance with the Grading Recommendations Assessment, Development and Evaluation (GRADE) system, (2) the quality of the CPGs using the Appraisal of Guidelines for Research and Evaluation (AGREE) II, and (3) whether the strength of the recommendations for acupuncture was consistent with each CPG's predefined procedure.

Results: Seventeen CPGs including 23 recommendations in total were identified and assessed. (1) Three CPGs were in accordance with the GRADE system. (2) The mean score of overall assessment using AGREE II was 4.5 on a 7-point Likert scale. The mean domain scores were 77% for domain 1 (scope and purpose), 54% for domain 2 (stakeholder involvement), 48% for domain 3 (rigor of development), 78% for domain 4 (clarity of presentation), 20% for domain 5 (applicability), and 51% for domain 6 (editorial independence). (3) The strength of the recommendations for acupuncture in two CPGs was judged to be underestimated. Some of the CPGs contained elementary problems that were not considered in AGREE II.

Conclusion: The methodological quality of Japanese CPGs including recommendations for acupuncture was not necessarily high. Since technical issues exist in each field of therapy, the respective experts should be involved in developing and reviewing CPGs to disseminate accurate health information.

Keywords: AGREE II; Acupuncture; Clinical practice guidelines; GRADE system; Recommendation.