On generalized fixed sequence procedures for controlling the FWER

Stat Med. 2015 Dec 30;34(30):3968-83. doi: 10.1002/sim.6603. Epub 2015 Jul 30.

Abstract

Testing a sequence of pre-ordered hypotheses to decide which of these can be rejected or accepted while controlling the familywise error rate (FWER) is of importance in many scientific studies such as clinical trials. In this paper, we first introduce a generalized fixed sequence procedure whose critical values are defined by using a function of the numbers of rejections and acceptances, and which allows follow-up hypotheses to be tested even if some earlier hypotheses are not rejected. We then construct the least favorable configuration for this generalized fixed sequence procedure and present a sufficient condition for the FWER control under arbitrary dependence. Based on the condition, we develop three new generalized fixed sequence procedures controlling the FWER under arbitrary dependence. We also prove that each generalized fixed sequence procedure can be described as a specific closed testing procedure. Through simulation studies and a clinical trial example, we compare the power performance of these proposed procedures with those of the existing FWER controlling procedures. Finally, when the pairwise joint distributions of the true null p-values are known, we further improve these procedures by incorporating pairwise correlation information while maintaining the control of the FWER. Copyright © 2015 John Wiley & Sons, Ltd.

Keywords: critical values; fallback procedure; familywise error rate; fixed sequence procedure; multiple testing; power.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Biostatistics / methods*
  • Clinical Trials as Topic / statistics & numerical data*
  • Data Interpretation, Statistical
  • Humans
  • Models, Statistical