Assessing risk of bias judgments for blinding of outcome assessors in Cochrane reviews

J Comp Eff Res. 2020 Jun;9(8):585-593. doi: 10.2217/cer-2019-0181. Epub 2020 May 27.

Abstract

Aim: Adequate judging of risk of bias (RoB) for blinding of outcome assessors (detection bias) is important for supporting highest level of evidence. Materials & methods: Judgments and supporting comments for detection bias were retrieved from RoB tables reported in Cochrane reviews. We categorized comments, and then compared judgment and supporting comment with instructions from the Cochrane Handbook. Results: We analyzed 8656 judgments for detection bias from 7626 trials included in 575 reviews. Overall, 1909 judgments (22%) were not in line with the Cochrane Handbook. In 9% of trials, the authors split the detection bias domain according to outcomes. Here, prevalence of inadequate judgments was 19%. Conclusion: Interventions to improve RoB assessments in systematic reviews should be explored.

Keywords: Cochrane; blinding; detection bias; outcome assessors; risk of bias; systematic reviews.

MeSH terms

  • Bias
  • Humans
  • Judgment*
  • Outcome Assessment, Health Care / methods*
  • Outcome Assessment, Health Care / statistics & numerical data*
  • Review Literature as Topic*
  • Risk Assessment