Ultrasound radiomics based XGBoost model to differential diagnosis thyroid nodules and unnecessary biopsy rate: Individual application of SHapley additive exPlanations

J Clin Ultrasound. 2024 Mar-Apr;52(3):305-314. doi: 10.1002/jcu.23631. Epub 2023 Dec 27.

Abstract

Objectives: Radiomics-based eXtreme gradient boosting (XGBoost) model was developed to differentiate benign thyroid nodules from malignant thyroid nodules and to prevent unnecessary thyroid biopsies, including positive and negative effects.

Methods: The study evaluated a data set of ultrasound images of thyroid nodules in patients retrospectively, who initially received ultrasound-guided fine-needle aspiration biopsy (FNAB) for diagnostic purposes. According to ACR TI-RADS, a total of five ultrasound feature categories and the maximum size of the nodule were determined by four radiologists. A radiomics score was developed by the LASSO algorithm from the ultrasound-based radiomics features. An interpretative method based on Shapley additive explanation (SHAP) was developed. XGBoost was compared with ACR TI-RADS for its diagnostic performance and FNAB rate and was compared with six other machine learning models to evaluate the model performance.

Results: Finally, 191 thyroid nodules were examined from 177 patients. The radiomics score were calculated using 8 features, which were selected among 789 candidate features generated from the ultrasound images. The model yielded an AUC of 93% in the training cohort and 92% in the test cohort. It outperformed traditional machine learning models in assessing the nature of thyroid nodules. Compared with ACR TI-RADS, the FNAB rate decreased from 34% to 30% in training and from 35% to 41% in test.

Conclusions: The radiomics-based XGBoost model proposed could distinguish benign and malignant thyroid nodules, thereby reduced significantly the number of unnecessary FNAB. It was effective in making preoperative decisions and managing selected patients using the SHAP visual interpretation tools.

Keywords: SHapley additive exPlanations; eXtreme gradient boosting; radiomics; thyroid nodule; ultrasound.

MeSH terms

  • Biopsy, Fine-Needle
  • Diagnosis, Differential
  • Humans
  • Radiomics
  • Retrospective Studies
  • Thyroid Nodule* / diagnostic imaging
  • Thyroid Nodule* / pathology
  • Ultrasonography / methods