Development and validation of an administrative data algorithm to identify adults who have endoscopic sinus surgery for chronic rhinosinusitis

J Otolaryngol Head Neck Surg. 2017 May 8;46(1):38. doi: 10.1186/s40463-017-0216-0.

Abstract

Background: This was a diagnostic accuracy study to develop an algorithm based on administrative database codes that identifies patients with Chronic Rhinosinusitis (CRS) who have endoscopic sinus surgery (ESS).

Methods: From January 1st, 2011 to December 31st, 2012, a chart review was performed for all hospital-identified ESS surgical encounters. The reference standard was developed as follows: cases were assigned to encounters in which ESS was performed for Otolaryngologist-diagnosed CRS; all other chart review encounters, and all other hospital surgical encounters during the timeframe were controls. Algorithm development was based on International Classification of Diseases, version 10 (ICD-10) diagnostic codes and Canadian Classification of Health Interventions (CCI) procedural codes. Internal model validation was performed with a similar chart review for all model-identified cases and 200 randomly selected controls during the following year.

Results: During the study period, 347 cases and 185,007 controls were identified. The predictive model assigned cases to all encounters that contained at least one CRS ICD-10 diagnostic code and at least one ESS CCI procedural code. Compared to the reference standard, the algorithm was very accurate: sensitivity 96.0% (95%CI 93.2-97.7), specificity 100% (95% CI 99.9-100), and positive predictive value 95.4% (95%CI 92.5-97.3). Internal validation using chart review for the following year revealed similar accuracy: sensitivity 98.9% (95%CI 95.8-99.8), specificity 97.1% (95%CI 93.4-98.8), and positive predictive value 96.9% (95%CI 93.0-99.8).

Conclusion: A simple model based on administrative database codes accurately identified ESS-CRS encounters. This model can be used in population-based cohorts to study longitudinal outcomes for the ESS-CRS population.

Keywords: Administrative database research; Chronic rhinosinusitis; Diagnostic codes; Endoscopic sinus surgery.

MeSH terms

  • Adult
  • Algorithms*
  • Chronic Disease
  • Databases, Factual
  • Endoscopy*
  • Female
  • Humans
  • International Classification of Diseases
  • Male
  • Retrospective Studies
  • Rhinitis / diagnosis*
  • Rhinitis / surgery*
  • Sensitivity and Specificity
  • Sinusitis / diagnosis*
  • Sinusitis / surgery*