External validation of FRISBEE 5-year fracture prediction models: a registry-based cohort study

Abstract

Five-year fracture risk prediction from the Fracture Risk Brussels Epidemiological Enquiry (FRISBEE) models was externally tested in 9716 Canadian women and demonstrated good discrimination but consistently overestimated risk.

Introduction: Five-year risk prediction models for all fractures, major osteoporotic fractures (MOFs) and central fractures (proximal to forearm and ankle) from the FRISBEE cohort demonstrated good performance in the original derivation cohort. Our aim was to externally validate the FRISBEE-based 5-year prediction models in routine practice.

Methods: Using the population-based Manitoba Bone Mineral Density (BMD) registry, we identified women aged 60-85 years undergoing baseline BMD assessment from September 1, 2012 to March 31, 2018. Five-year probabilities of all fractures, MOFs and central fractures were calculated using the FRISBEE prediction models. We identified incident non-traumatic fractures up to 5 years from population-based healthcare data sources. Performance characteristics included area under the receiver operating characteristic curve (AUROC), gradient of risk (hazard ratio [HR] per SD increase and across risk tertiles) from Cox regression analysis, and calibration (ratio 5-year observed cumulative incidence to predicted fracture probability).

Results: We included 9716 women (mean age 70.7 + / - SD 5.3 years). During a mean observation time of 2.5 years, all fractures, MOFs and central fractures were identified in 377 (3.9%), 264 (2.7%) and 259 (2.7%) of the women. AUROC showed significant fracture risk stratification with the FRISBEE models (all fractures 0.69 [95%CI 0.67-0.72], MOFs 0.71 [95%CI 0.68-0.74], central fractures 0.72 [95%CI 0.69-0.75]). There was a strong gradient of risk for predicting fracture outcomes per SD increase (HRs from 1.98 to 2.26) and across risk tertiles (HRs for middle vs lowest from 2.25 to 2.41, HRs for highest vs lowest from 4.70 to 6.50). However, risk was overestimated for all fractures (calibration-in-the-large 0.63, calibration slope 0.63), MOF (calibration-in-the-large 0.51, calibration slope 0.57) and central fractures (calibration-in-the-large 0.55, calibration slope 0.60).

Conclusions: FRISBEE 5-year prediction models were externally validated to stratify fracture risk similar to the derivation cohort, but would need recalibration for Canada as risk was overestimated.

Keywords: FRISBEE; Fracture; Osteoporosis; Risk prediction.