A robust method using propensity score stratification for correcting verification bias for binary tests

Biostatistics. 2012 Jan;13(1):32-47. doi: 10.1093/biostatistics/kxr020. Epub 2011 Aug 18.

Abstract

Sensitivity and specificity are common measures of the accuracy of a diagnostic test. The usual estimators of these quantities are unbiased if data on the diagnostic test result and the true disease status are obtained from all subjects in an appropriately selected sample. In some studies, verification of the true disease status is performed only for a subset of subjects, possibly depending on the result of the diagnostic test and other characteristics of the subjects. Estimators of sensitivity and specificity based on this subset of subjects are typically biased; this is known as verification bias. Methods have been proposed to correct verification bias under the assumption that the missing data on disease status are missing at random (MAR), that is, the probability of missingness depends on the true (missing) disease status only through the test result and observed covariate information. When some of the covariates are continuous, or the number of covariates is relatively large, the existing methods require parametric models for the probability of disease or the probability of verification (given the test result and covariates), and hence are subject to model misspecification. We propose a new method for correcting verification bias based on the propensity score, defined as the predicted probability of verification given the test result and observed covariates. This is estimated separately for those with positive and negative test results. The new method classifies the verified sample into several subsamples that have homogeneous propensity scores and allows correction for verification bias. Simulation studies demonstrate that the new estimators are more robust to model misspecification than existing methods, but still perform well when the models for the probability of disease and probability of verification are correctly specified.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Aged
  • Bias
  • Biostatistics
  • Depression / diagnosis
  • Diagnostic Tests, Routine / statistics & numerical data*
  • Humans
  • Models, Statistical
  • Prevalence
  • Propensity Score
  • Sensitivity and Specificity
  • Statistics, Nonparametric