Predictive value of machine learning on fracture risk in osteoporosis: a systematic review and meta-analysis

BMJ Open. 2023 Dec 9;13(12):e071430. doi: 10.1136/bmjopen-2022-071430.

Abstract

Objectives: Early identification of fracture risk in patients with osteoporosis is essential. Machine learning (ML) has emerged as a promising technique to predict the risk, whereas its predictive performance remains controversial. Therefore, we conducted this systematic review and meta-analysis to explore the predictive efficiency of ML for the risk of fracture in patients with osteoporosis.

Methods: Relevant studies were retrieved from four databases (PubMed, Embase, Cochrane Library and Web of Science) until 31 May 2023. A meta-analysis of the C-index was performed using a random-effects model, while a bivariate mixed-effects model was used for the meta-analysis of sensitivity and specificity. In addition, subgroup analysis was performed according to the types of ML models and fracture sites.

Results: Fifty-three studies were included in our meta-analysis, involving 15 209 268 patients, 86 prediction models specifically developed for the osteoporosis population and 41 validation sets. The most commonly used predictors in these models encompassed age, BMI, past fracture history, bone mineral density T-score, history of falls, BMD, radiomics data, weight, height, gender and other chronic diseases. Overall, the pooled C-index of ML was 0.75 (95% CI: 0.72, 0.78) and 0.75 (95% CI: 0.71, 0.78) in the training set and validation set, respectively; the pooled sensitivity was 0.79 (95% CI: 0.72, 0.84) and 0.76 (95% CI: 0.80, 0.81) in the training set and validation set, respectively; and the pooled specificity was 0.81 (95% CI: 0.75, 0.86) and 0.83 (95% CI: 0.72, 0.90) in the training set and validation set, respectively.

Conclusions: ML has a favourable predictive performance for fracture risk in patients with osteoporosis. However, most current studies lack external validation. Thus, external validation is required to verify the reliability of ML models.

Prospero registration number: CRD42022346896.

Keywords: Fractures; Machine learning; Meta-Analysis; Osteoporosis.

Publication types

  • Meta-Analysis
  • Systematic Review
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Bone Density
  • Humans
  • Osteoporosis* / complications
  • Osteoporosis* / diagnosis
  • Osteoporosis* / epidemiology
  • Osteoporotic Fractures* / etiology
  • Reproducibility of Results
  • Risk Assessment / methods