Risk-adjustment of diabetes health outcomes improves the accuracy of performance benchmarking

Sci Rep. 2018 Jul 6;8(1):10261. doi: 10.1038/s41598-018-28101-w.

Abstract

Benchmarking clinical performance by comparing diabetes health outcomes across healthcare providers drives quality improvement. Non-care related patient risk factors are likely to confound clinical performance, but few studies have tested this. This cross-sectional study is the first Australian investigation to analyse the effect of risk-adjustment for non-care related patient factors on benchmarking. Data from 4,670 patients with type 2 (n = 3,496) or type 1 (n = 1,174) were analysed across 49 diabetes centres. Diabetes health outcomes (HbA1c levels, LDL-cholesterol levels, systolic blood pressure and rates of severe hypoglycaemia) were risk-adjusted for non-care related patient factors using multivariate stepwise linear and logistic regression models. Unadjusted and risk-adjusted funnel plots were constructed for each outcome to identify low-performing and high-performing outliers. Unadjusted funnel plots identified 27 low-performing outliers and 15 high-performing outliers across all diabetes health outcomes. After risk-adjustment, 22 (81%) low-performing outliers and 13 (87%) high-performing outliers became inliers. Additionally, one inlier became a low-performing outlier. Risk-adjustment of diabetes health outcomes significantly reduced false positives and false negatives for outlier performance, hence providing more accurate information to guide quality improvement activity.

Publication types

  • Multicenter Study

MeSH terms

  • Adult
  • Aged
  • Australia / epidemiology
  • Benchmarking*
  • Cross-Sectional Studies
  • Diabetes Mellitus, Type 1 / physiopathology*
  • Diabetes Mellitus, Type 2 / physiopathology*
  • Diabetes, Gestational / physiopathology*
  • Female
  • Humans
  • Hypoglycemia / epidemiology*
  • Incidence
  • Male
  • Middle Aged
  • Outcome Assessment, Health Care*
  • Pregnancy
  • Quality Improvement
  • Quality Indicators, Health Care
  • Risk Assessment / methods*
  • Risk Factors