A Systematic Review of Surgical Randomized Controlled Trials: Part I. Risk of Bias and Outcomes: Common Pitfalls Plastic Surgeons Can Overcome

Plast Reconstr Surg. 2016 Feb;137(2):696-706. doi: 10.1097/01.prs.0000475766.83901.5b.

Abstract

Background: The authors investigated the methodological validity of plastic surgery randomized controlled trials that compared surgical interventions.

Methods: An electronic search identified randomized controlled trials published between 2000 and 2013. Reviewers, independently and in duplicate, assessed manuscripts and performed data extraction. Methodological safeguards (randomization, allocation concealment, blinding, and incomplete outcome data) were examined using the Cochrane risk of bias tool. Regression analysis was used to identify trial characteristics associated with risk of bias.

Results: Of 1664 potentially eligible studies, 173 randomized controlled trials were included. Proper randomization and allocation concealment methods were described in 61 of 173 (35 percent) and 21 of 173 (12 percent), respectively. Outcome assessors were blinded in 58 of 173 (34 percent) trials, and patients were blinded in 45 of 173 (26 percent). Follow-up rates were high, with 99 of 173 (57 percent) randomized controlled trials appearing to have complete follow-up. An intention-to-treat analysis was used in 19 of 173 (11 percent) trials. One-third (58 of 173, 34 percent) did not state their primary outcomes. The most common type of primary outcome used was a symptom/quality of life, class III, outcome (73 of 173, 42 percent). Multinomial regression demonstrated trials reporting an a priori sample size as more likely to have a low risk of bias (p = 0.001).

Conclusions: This article highlights methodological safeguards that plastic surgeons should consider when interpreting results of a surgical randomized controlled trial. Allocation concealment, outcome assessor blinding, and patient blinding were identified as areas of concern. Valid and reliable outcome measures are being used in plastic surgery. This analysis provides strong rationale for continued focus on the performance and reporting of clinical trials within our specialty.

Publication types

  • Research Support, Non-U.S. Gov't
  • Review
  • Systematic Review

MeSH terms

  • Bias*
  • Outcome Assessment, Health Care
  • Randomized Controlled Trials as Topic / statistics & numerical data*
  • Risk
  • Surgery, Plastic*