Replication of systematic reviews: is it to the benefit or detriment of methodological quality?

J Clin Epidemiol. 2023 Oct:162:98-106. doi: 10.1016/j.jclinepi.2023.08.012. Epub 2023 Aug 28.

Abstract

Objectives: To perform an overview of the overlap of systematic reviews (SRs) assessing direct oral anticoagulants and characterize these reviews in terms of bias and methodological quality (PROSPERO: CRD42022316273).

Study design and setting: A PubMed-indexed search was performed from inception to January 31, 2022 to identify SRs evaluating direct oral anticoagulants in patients treated for an acute venous thromboembolism. The risk of bias of these SRs was assessed according to the Risk Of Bias In Systematic reviews tool. Redundancy was defined as overlap in terms of the type of population considered, the interventions compared, and the studies included.

Results: A total of 144 SRs were evaluated, of which 26 (18.1%) were classified as original, 87 (60.4%) as conceptual replications, and 31 (21.5%) as excessive replications. The risk of bias was high in 19 (73.1%) of the original SRs, 65 (74.7%) of the conceptual replications, and 21 (67.7%) of the excessive replications. Compared to the original SRs, the overall methodological quality was not improved in either conceptual or excessive replications.

Conclusion: A large number of SRs was classified as replications; a fifth constituted excessive replications. The replications showed no improvement in overall methodological quality compared to the original SRs.

Keywords: Bias; Duplication; Methodological quality; Redundancy; Replication; Systematic review.

MeSH terms

  • Anticoagulants* / therapeutic use
  • Bias
  • Humans
  • Systematic Reviews as Topic

Substances

  • Anticoagulants