Statistical challenges in assessing potential efficacy of complex interventions in pilot or feasibility studies

Stat Methods Med Res. 2016 Jun;25(3):997-1009. doi: 10.1177/0962280215589507. Epub 2015 Jun 12.

Abstract

Early phase trials of complex interventions currently focus on assessing the feasibility of a large randomised control trial and on conducting pilot work. Assessing the efficacy of the proposed intervention is generally discouraged, due to concerns of underpowered hypothesis testing. In contrast, early assessment of efficacy is common for drug therapies, where phase II trials are often used as a screening mechanism to identify promising treatments. In this paper, we outline the challenges encountered in extending ideas developed in the phase II drug trial literature to the complex intervention setting. The prevalence of multiple endpoints and clustering of outcome data are identified as important considerations, having implications for timely and robust determination of optimal trial design parameters. The potential for Bayesian methods to help to identify robust trial designs and optimal decision rules is also explored.

Keywords: Complex interventions; feasibility; phase II; pilot; sample size.

MeSH terms

  • Bayes Theorem*
  • Clinical Trials, Phase II as Topic / methods*
  • Feasibility Studies
  • Humans
  • Pilot Projects
  • Research Design*
  • Sample Size