Purpose: To our knowledge the reliability of administrative claims codes to report postoperative radical cystectomy complications has not been examined. We compared complications identified by claims data to those abstracted from clinical chart review following radical cystectomy.
Methods: We manually reviewed the charts of 268 patients treated with radical cystectomy between 2014 and 2016 for 30-day complications and queried administrative complication coding using 805 ICD-9/10 codes. Complications were categorized. Using Cohen κ statistics we assessed agreement between the 2 methods of complication reporting for 1 or more postoperative complications overall, categorical complications and complications stratified by the top quartile length of hospital stay and patients who were readmitted.
Results: At least 1 or more complications were recorded in 122 patients (45.5%) through manual chart review and 80 (29.9%) were recorded via claim coding data with a concordance rate of κ=0.16, indicating weak agreement. Concordance was generally weak for categorical complication rates (range 0.05 to 0.36). However, when examining only the top length of stay quartile, 1 or more complications were reported in 32 patients (65%) by the manual chart review and in 12 (25%) via coding data with a concordance rate of κ=-0.2. Agreement was weak, similar to the total cohort.
Conclusions: Manual chart review and claim code identification of complications are not highly concordant even when stratified by patients with an extended length of stay, who are known to have more frequent complications. Researchers and administrators should be aware of these differences and exercise caution when interpreting complication reports.
Keywords: International Classification of Diseases; clinical coding; cystectomy; postoperative complications; urinary bladder.