Assessing the robustness of results from clinical trials and meta-analyses with the fragility index

Am J Obstet Gynecol. 2023 Mar;228(3):276-282. doi: 10.1016/j.ajog.2022.08.053. Epub 2022 Sep 6.

Abstract

The fragility index has been increasingly used to assess the robustness of the results of clinical trials since 2014. It aims at finding the smallest number of event changes that could alter originally statistically significant results. Despite its popularity, some researchers have expressed several concerns about the validity and usefulness of the fragility index. It offers a comprehensive review of the fragility index's rationale, calculation, software, and interpretation, with emphasis on application to studies in obstetrics and gynecology. This article presents the fragility index in the settings of individual clinical trials, standard pairwise meta-analyses, and network meta-analyses. Moreover, this article provides worked examples to demonstrate how the fragility index can be appropriately calculated and interpreted. In addition, the limitations of the traditional fragility index and some solutions proposed in the literature to address these limitations were reviewed. In summary, the fragility index is recommended to be used as a supplemental measure in the reporting of clinical trials and a tool to communicate the robustness of trial results to clinicians. Other considerations that can aid in the fragility index's interpretation include the loss to follow-up and the likelihood of data modifications that achieve the loss of statistical significance.

Keywords: P value; confidence interval; fragility index; meta-analysis; research replicability; statistical significance.

Publication types

  • Review

MeSH terms

  • Clinical Trials as Topic
  • Humans
  • Meta-Analysis as Topic
  • Network Meta-Analysis
  • Probability*