This paper discusses the problem of disease prevalence in clinical studies, focusing on multiple comparisons based on stratified partially validated series in the presence of a gold standard. Five test statistics, including two Wald-type test statistics, the inverse hyperbolic tangent transformation test statistic, likelihood ratio test statistic, and score test statistic, are proposed to conduct multiple comparisons. To control the overall type I error rate, several adjustment procedures are developed, namely the Bonferroni, Single-step adjusted MaxT, Single-step adjusted MinP, Holm's Step-down, and Hochberg's step-up procedures, based on these test statistics. The performance of the proposed methods is evaluated through simulation studies in terms of the empirical type I error rate and empirical power. Simulation results show that the Single-step adjusted MaxT procedure and Single-step adjusted MinP procedure generally outperform the other three procedures, and these two test procedures based on all test statistics have satisfactory performance. Notably, the Single-step adjusted MinP procedure tends to exhibit higher empirical power than the Single-step adjusted MaxT procedure. Furthermore, the Step-down and Step-up procedures show greater power compared to the Bonferroni method. The study also observes that as the validated ratio increases, the empirical type I errors of all test procedures approach the nominal level while maintaining higher power. Two real examples are presented to illustrate the proposed methods.
Keywords: Partially validated series; Single-step adjusted MaxT test procedure; Single-step adjusted MinP test procedure; multiple test; step-down procedure; step-up procedure.