Simulation study comparing analytical methods for single-item longitudinal patient-reported outcomes data

Qual Life Res. 2023 Mar;32(3):827-839. doi: 10.1007/s11136-022-03267-z. Epub 2022 Oct 17.

Abstract

Purpose: Efficient analytical methods are necessary to make reproducible inferences on single-item longitudinal ordinal patient-reported outcome (PRO) data. A thorough simulation study was performed to compare the performance of the semiparametric probabilistic index models (PIM) with a longitudinal analysis using parametric cumulative logit mixed models (CLMM).

Methods: In the setting of a control and intervention arm, we compared the power of the PIM and CLMM to detect differences in PRO adverse event (AE) between these groups using several existing and novel summary scores of PROs. For each scenario, PRO data were simulated using copula multinomial models. Comparisons were also exemplified using clinical trial data.

Results: On average, CLMM provided substantially greater power than the PIM to detect differences in PRO-AEs between the groups when the baseline-adjusted method was used, and a small advantage in power when using the baseline symptom as a covariate.

Conclusion: Although the CLMM showed the best performance among analytical methods, it relies on assumptions difficult to verify and that might not be fulfilled in the real world, therefore our recommendation is the use of PIM models with baseline symptom as a covariate.

Keywords: Adverse event; Cumulative logit mixed model; PRO-CTCAE; Patient-reported outcome; Probabilistic index model; Type I and II errors.

Publication types

  • Comparative Study

MeSH terms

  • Computer Simulation
  • Humans
  • Logistic Models
  • Models, Statistical*
  • Patient Reported Outcome Measures
  • Quality of Life* / psychology