Predicting the Postoperative Outcome of Percutaneous Nephrolithotomy with Machine Learning System: Software Validation and Comparative Analysis with Guy's Stone Score and the CROES Nomogram

J Endourol. 2020 Jun;34(6):692-699. doi: 10.1089/end.2019.0475. Epub 2020 Feb 3.

Abstract

Purpose: To validate the output of a machine learning-based software as an intelligible interface for predicting multiple outcomes after percutaneous nephrolithotomy (PCNL). We compared the performance of this system with Guy's stone score (GSS) and the Clinical Research Office of Endourological Society (CROES) nomogram. Patients and Methods: Data from 146 adult patients (87 males, 59%) who underwent PCNL at our institute were used. To validate the system, accuracy of the software for predicting each postoperative outcome was compared with the actual outcome. Similarly, preoperative data were analyzed with GSS and CROES nomograms to determine stone-free status as predicted by these nomograms. A receiver operating characteristic (ROC) curve was generated for each scoring system, and the area under the ROC curve (AUC) was calculated and used to assess the predictive performance of all three models. Results: Overall stone-free rate was 72.6% (106/146). Forty of 146 patients (27.4%) were scheduled for 42 ancillary procedures (extracorporeal shockwave lithotripsy [SWL] [n = 31] or repeat PCNL [n = 11]) to manage residual renal stones. Overall, the machine learning system predicted the PCNL outcomes with an accuracy ranging between 80% and 95.1%. For predicting the stone-free status, the AUC for the software (0.915) was significantly larger than the AUC for GSS (0.615) or CROES nomograms (0.621) (p < 0.001). Conclusion: At the internal institutional level, the machine learning-based software was a promising tool for recording, processing, and predicting outcomes after PCNL. Validation of this system against an external dataset is highly recommended before its widespread application.

Keywords: artificial intelligence; machine learning; percutaneous nephrolithotomy; renal calculus; support vector machines.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Humans
  • Kidney Calculi* / surgery
  • Machine Learning
  • Male
  • Nephrolithotomy, Percutaneous*
  • Nomograms
  • Operative Time
  • Postoperative Complications
  • Retrospective Studies
  • Software Validation
  • Treatment Outcome