A simple scoring model based on machine learning predicts intravenous immunoglobulin resistance in Kawasaki disease

Clin Rheumatol. 2023 May;42(5):1351-1361. doi: 10.1007/s10067-023-06502-1. Epub 2023 Jan 11.

Abstract

Introduction: In Kawasaki disease (KD), accurate prediction of intravenous immunoglobulin (IVIG) resistance is crucial to reduce a risk for developing coronary artery lesions.

Objective: To establish a simple scoring model predicting IVIG resistance in KD patients based on the machine learning model.

Methods: A retrospective cohort study of 1002 KD patients diagnosed at 12 facilities for 10 years, in which 22.7% were resistant to initial IVIG treatment. We performed machine learning with diverse models using 30 clinical variables at diagnosis in 801 and 201 cases for training and test datasets, respectively. SHAP was applied to identify the variables that influenced the prediction model. A scoring model was designed using the influential clinical variables based on the Shapley additive explanation results.

Results: Light gradient boosting machine model accurately predicted IVIG resistance (area under the receiver operating characteristic curve (AUC), 0.78; sensitivity, 0.50; specificity, 0.88). Next, using top three influential features (days of illness at initial therapy, serum levels of C-reactive protein, and total cholesterol), we designed a simple scoring system. In spite of its simplicity, it predicted IVIG resistance (AUC, 0.72; sensitivity, 0.49; specificity, 0.82) as accurately as machine learning models. Moreover, accuracy of our scoring system with three clinical features was almost identical to that of Gunma score with seven clinical features (AUC, 0.73; sensitivity, 0.53; specificity, 0.83), a well-known logistic regression scoring model.

Conclusion: A simple scoring system based on the findings in machine learning seems to be a useful tool to accurately predict IVIG resistance in KD patients.

Keywords: Intravenous immunoglobulin resistance; Kawasaki disease; Machine learning; Shapley additive explanation.

MeSH terms

  • Drug Resistance
  • Humans
  • Immunoglobulins, Intravenous* / therapeutic use
  • Machine Learning*
  • Mucocutaneous Lymph Node Syndrome*
  • ROC Curve
  • Retrospective Studies

Substances

  • Immunoglobulins, Intravenous