Randomized Controlled Trials Comparing Bone-Patellar Tendon-Bone Versus Hamstring Tendon Autografts in Anterior Cruciate Ligament Reconstruction Surgery Are Statistically Fragile: A Systematic Review

Abstract

Purpose: To assess the statistical fragility of recently published randomized controlled trials (RCTs) comparing the use of hamstring tendon autograft with bone-patellar tendon-bone autograft for anterior cruciate ligament (ACL) reconstruction.

Methods: The PubMed, Embase, and MEDLINE databases were queried for RCTs published since 2010 comparing autograft type (bone-patellar tendon-bone vs hamstring tendon) in ACL reconstruction surgery. The fragility index (FI) and reverse FI (rFI) were determined for significant and nonsignificant outcomes, respectively, as the number of outcome reversals required to change statistical significance. The fragility quotient (FQ) and reverse FQ, representing fragility as a proportion of the study population, were calculated by dividing the FI and rFI, respectively, by the sample size.

Results: We identified 19 RCTs reporting 55 total dichotomous outcomes. The median FI of the 55 total outcomes was 5 (interquartile range [IQR], 4-7), meaning a median of 5 outcome event reversals would alter the outcomes' significance. Five outcomes were reported as statistically significant with a median FI of 4 (IQR, 2-6), meaning a median of 4 outcome event reversals would change outcomes to be nonsignificant. Fifty outcomes were reported as nonsignificant with a median rFI of 5 (IQR, 4-7), meaning a median of 5 outcome event reversals would change outcomes to be significant. The FQ and reverse FQ for significant and nonsignificant outcomes were 0.025 (IQR, 0.018-0.045) and 0.082 (IQR, 0.041-0.106), respectively. For 61.8% of outcomes, patients lost to follow-up exceeded the corresponding FI or rFI.

Conclusions: There is substantial statistical fragility in recent RCTs on autograft choice in ACL reconstruction surgery given that altering a few outcome events is sufficient to reverse study findings. For over half of outcomes, maintaining patients lost to follow-up may have been sufficient to reverse study conclusions.

Clinical relevance: We recommend co-reporting FIs and P values to provide a more comprehensive representation of a study's conclusions when conducting an RCT.