Adherence to the PRISMA statement and its association with risk of bias in systematic reviews published in rehabilitation journals: A meta-research study

Tiziano Innocenti; Daniel Feller; Silvia Giagio; Stefano Salvioli; Silvia Minnucci; Fabrizio Brindisino; Carola Cosentino; Leonardo Piano; Alessandro Chiarotto; Raymond Ostelo

doi:10.1016/j.bjpt.2022.100450

Adherence to the PRISMA statement and its association with risk of bias in systematic reviews published in rehabilitation journals: A meta-research study

Braz J Phys Ther. 2022 Sep-Oct;26(5):100450. doi: 10.1016/j.bjpt.2022.100450. Epub 2022 Oct 14.

Authors

Affiliations

¹ Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Movement Sciences, the Netherlands; GIMBE Foundation, Bologna, Italy. Electronic address: t.innocenti@vu.nl.
² Provincial Agency for Health of the Autonomous Province of Trento, Trento, Italy.
³ Division of Occupational Medicine, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Bologna, Italy; Department of Biomedical and Neuromotor Sciences (DIBINEM), Alma Mater Studiorum, University of Bologna, Bologna, Italy.
⁴ GIMBE Foundation, Bologna, Italy; Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, University of Genoa, Genoa, Italy.
⁵ Department of Clinical Science and Translational Medicine, University of Rome Tor Vergata, Rome, Italy.
⁶ Department of Clinical Science and Translational Medicine, University of Rome Tor Vergata, Rome, Italy; Department of Medicine and Health Science "Vincenzo Tiberio", University of Molise, Campobasso, Italy.
⁷ Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, University of Genoa, Genoa, Italy.
⁸ Unit of Rehabilitation and Functional Recovery, Fondazione dei Santi Lorenzo e Teobaldo, Rodello, Italy.
⁹ Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Movement Sciences, the Netherlands; Department of General Practice, Erasmus MC, University Medical Center, Rotterdam, the Netherlands.
¹⁰ Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Movement Sciences, the Netherlands; Department of Epidemiology and Data Science, Amsterdam UMC, Location VUmc, Amsterdam Movement Sciences research institute, the Netherlands.

Abstract

Background: Systematic reviews (SRs) and meta-analyses are essential resources for the clinicians. They allow to evaluate the strengths and the weaknesses of the evidence to support clinical decision-making if they are adequately reported. Little is known in the rehabilitation field about the completeness of reporting of SRs and its relationship with the risk of bias (ROB).

Objectives: Primary: 1) To evaluate the completeness of reporting of systematic reviews (SRs) published in rehabilitation journals by evaluating their adherence to the PRISMA 2009 checklist, 2) To investigate the relationship between ROB and completeness of reporting. Secondary: To study the association between completeness of reporting and journals and study characteristics.

Methods: A random sample of 200 SRs published between 2011 and 2020 in 68 rehabilitation journals was indexed under the "rehabilitation" category in the InCites database. Two independent reviewers evaluated adherence to the PRISMA checklist and assessed ROB using the ROBIS tool. Overall adherence and adherence to each PRISMA item and section were calculated. Regression analyses investigated the association between completeness of reporting, ROB, and other characteristics (impact factor, publication options, publication year, and study protocol registration).

Results: The mean overall PRISMA adherence across the 200 studies considered was 61.4%. Regression analyses show that having a high overall ROB is a significant predictor of lower adherence (B=-7.1%; 95%CI -12.1, -2.0). Studies published in fourth quartile journals displayed a lower overall adherence (B= -7.2%; 95%CI -13.2, -1.3) than those published in first quartile journals; the overall adherence increased (B= 11.9%; 95%CI 5.9, 18.0) if the SR protocol was registered. No association between adherence, publication options, and publication year was found.

Conclusion: Reporting completeness in rehabilitation SRs is suboptimal and is associated with ROB, impact factor, and study registration. Authors of SRs should improve adherence to the PRISMA guideline, and journal editors should implement strategies to optimize the completeness of reporting.

Keywords: Meta-research; Randomised controlled trial; Rehabilitation; Reporting guidelines; Research quality; Risk of bias.

Publication types

Review

MeSH terms

Checklist
Humans
Periodicals as Topic*
Research Design