Epidemiology and Reporting Characteristics of Systematic Reviews in Orthopedic Journals: A Meta-Epidemiological Study

J Clin Med. 2023 Nov 10;12(22):7031. doi: 10.3390/jcm12227031.

Abstract

Systematic reviews (SRs) with complete reporting or rigorous methods can lead to less biased recommendations and decisions. A comprehensive analysis of the epidemiological and reporting characteristics of SRs in orthopedics is lacking. We evaluated 360 SRs, including 165 and 195 published in orthopedic journals in 2012 and 2022. According to the established reporting guidelines, we examined these SRs for key epidemiological characteristics, including focus areas, type of meta-analysis (MA), and reporting characteristics. Most SRs (71%) were therapy-related, with a significant proportion originating from authors in the USA, UK, and China. Pairwise MA was performed on half of the SRs. The proportion of protocol registrations improved by 2022 but remained low (33%). Despite a formal declaration of adherence to the reporting guidelines (68%), they were often not used and reported enough. Only 10% of the studies used full search strategies, including trial registries. Publication bias assessments, subgroup analyses, and sensitivity analyses were not even planned. The risk of bias assessment improved in 2022; however, the certainty of the evidence remained largely unassessed (8%). The use and reporting of standard methods in orthopedic SRs have remained suboptimal. Thus, authors, peer reviewers, journal editors, and readers should criticize the results more.

Keywords: PRISMA; full search strategy; meta-analysis; reporting guidelines; systemic reviews.

Publication types

  • Review

Grants and funding

This study was funded by the Systematic Review Workshop Peer Support Group (SRWS-PSG: https://community.camp-fire.jp/projects/view/187310 (accessed on 8 October 2023)). This funder played no role in the study design, study execution, data analyses, data interpretation, or decision to submit the results.