An outcome model approach to transporting a randomized controlled trial results to a target population

J Am Med Inform Assoc. 2019 May 1;26(5):429-437. doi: 10.1093/jamia/ocy188.

Abstract

Objective: Participants enrolled into randomized controlled trials (RCTs) often do not reflect real-world populations. Previous research in how best to transport RCT results to target populations has focused on weighting RCT data to look like the target data. Simulation work, however, has suggested that an outcome model approach may be preferable. Here, we describe such an approach using source data from the 2 × 2 factorial NAVIGATOR (Nateglinide And Valsartan in Impaired Glucose Tolerance Outcomes Research) trial, which evaluated the impact of valsartan and nateglinide on cardiovascular outcomes and new-onset diabetes in a prediabetic population.

Materials and methods: Our target data consisted of people with prediabetes serviced at the Duke University Health System. We used random survival forests to develop separate outcome models for each of the 4 treatments, estimating the 5-year risk difference for progression to diabetes, and estimated the treatment effect in our local patient populations, as well as subpopulations, and compared the results with the traditional weighting approach.

Results: Our models suggested that the treatment effect for valsartan in our patient population was the same as in the trial, whereas for nateglinide treatment effect was stronger than observed in the original trial. Our effect estimates were more efficient than the weighting approach and we effectively estimated subgroup differences.

Conclusions: The described method represents a straightforward approach to efficiently transporting an RCT result to any target population.

Keywords: electronic health records; machine learning; public health informatics; treatment heterogeneity.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Antihypertensive Agents / therapeutic use*
  • Cardiovascular Diseases / prevention & control
  • Diabetes Mellitus, Type 2
  • Disease Progression
  • Electronic Health Records
  • Evidence-Based Medicine
  • Humans
  • Hypoglycemic Agents / therapeutic use*
  • Machine Learning*
  • Nateglinide / therapeutic use*
  • Outcome Assessment, Health Care
  • Prediabetic State / drug therapy*
  • Randomized Controlled Trials as Topic
  • Translational Research, Biomedical
  • Valsartan / therapeutic use*

Substances

  • Antihypertensive Agents
  • Hypoglycemic Agents
  • Nateglinide
  • Valsartan