Accuracy of Canadian health administrative databases in identifying patients with rheumatoid arthritis: a validation study using the medical records of rheumatologists

Arthritis Care Res (Hoboken). 2013 Oct;65(10):1582-91. doi: 10.1002/acr.22031.

Abstract

Objective: Health administrative data can be a valuable tool for disease surveillance and research. Few studies have rigorously evaluated the accuracy of administrative databases for identifying rheumatoid arthritis (RA) patients. Our aim was to validate administrative data algorithms to identify RA patients in Ontario, Canada.

Methods: We performed a retrospective review of a random sample of 450 patients from 18 rheumatology clinics. Using rheumatologist-reported diagnosis as the reference standard, we tested and validated different combinations of physician billing, hospitalization, and pharmacy data.

Results: One hundred forty-nine rheumatology patients were classified as having RA and 301 were classified as not having RA based on our reference standard definition (study RA prevalence 33%). Overall, algorithms that included physician billings had excellent sensitivity (range 94-100%). Specificity and positive predictive value (PPV) were modest to excellent and increased when algorithms included multiple physician claims or specialist claims. The addition of RA medications did not significantly improve algorithm performance. The algorithm of "(1 hospitalization RA code ever) OR (3 physician RA diagnosis codes [claims] with ≥1 by a specialist in a 2-year period)" had a sensitivity of 97%, specificity of 85%, PPV of 76%, and negative predictive value of 98%. Most RA patients (84%) had an RA diagnosis code present in the administrative data within ±1 year of a rheumatologist's documented diagnosis date.

Conclusion: We demonstrated that administrative data can be used to identify RA patients with a high degree of accuracy. RA diagnosis date and disease duration are fairly well estimated from administrative data in jurisdictions of universal health care insurance.

Publication types

  • Research Support, Non-U.S. Gov't
  • Validation Study

MeSH terms

  • Adult
  • Aged
  • Algorithms
  • Arthritis, Rheumatoid / diagnosis*
  • Arthritis, Rheumatoid / epidemiology
  • Data Mining / statistics & numerical data*
  • Databases, Factual / statistics & numerical data*
  • Drug Prescriptions / statistics & numerical data
  • Fees and Charges / statistics & numerical data
  • Female
  • Hospitalization / statistics & numerical data
  • Humans
  • Male
  • Medical Records Systems, Computerized / statistics & numerical data*
  • Middle Aged
  • Ontario / epidemiology
  • Reproducibility of Results
  • Retrospective Studies
  • Rheumatology / statistics & numerical data*
  • Single-Payer System / statistics & numerical data*