ALL-IN meta-analysis: breathing life into living systematic reviews

F1000Res. 2022 May 19:11:549. doi: 10.12688/f1000research.74223.1. eCollection 2022.

Abstract

Science is justly admired as a cumulative process ("standing on the shoulders of giants"), yet scientific knowledge is typically built on a patchwork of research contributions without much coordination. This lack of efficiency has specifically been addressed in clinical research by recommendations for living systematic reviews and against research waste. We propose to further those recommendations with ALL-IN meta-analysis: Anytime Live and Leading INterim meta-analysis. ALL-IN provides statistical methodology for a meta-analysis that can be updated at any time-reanalyzing after each new observation while retaining type-I error guarantees, live-no need to prespecify the looks, and leading-in the decisions on whether individual studies should be initiated, stopped or expanded, the meta-analysis can be the leading source of information. We illustrate the method for time-to-event data, showing how synthesizing data at interim stages of studies can increase efficiency when studies are slow in themselves to provide the necessary number of events for completion. The meta-analysis can be performed on interim data, but does not have to. The analysis design requires no information about the number of patients in trials or the number of trials eventually included. So it can breathe life into living systematic reviews, through better and simpler statistics, efficiency, collaboration and communication.

Keywords: Anytime; Collaboration; Communication; Efficiency; Interim; Leading; Live; Meta-analysis; Research Waste.

Publication types

  • Meta-Analysis
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Humans
  • Research Design*

Grants and funding

This work is part of the NWO TOP-I research programme Safe Bayesian Inference assigned to Peter Grünwald, with project number 617.001.651, which is financed by the Dutch Research Counsil (Nederlandse Organisatie voor Wetenschappelijk Onderzoek; NWO).