Introduction: Artificial Intelligence (AI) and machine learning (ML) are used extensively in HICs to detect and control antibiotic resistance (AMR) in laboratories and clinical institutions. ML is designed to predict outcome variables using an algorithm to enable "machines" to learn the "rules" from the data. ML is increasingly being applied in intensive care units to identify AMR and to assist empiric antibiotic therapy. This study aimed to evaluate the performance of ML models for predicting AMR bacteria and resistance to antibiotics in two Vietnamese hospitals.
Patients and methods: A cross-sectional study combined with retrospective was conducted from 1st January 2020 to 30th June 2022. Five models were developed to predict antibiotic resistance of bacterial infections of ICU patients. Two datasets were prepared to predict AMR bacteria and antibiotics with ML models. The performance of the prediction models was evaluated by various indicators (sensitivity, specificity, precision, accuracy, F1-score, PRC, AuROC, and NormMCC) to determine the optimal time point for data selection. Python version 3.8 was used for statistical analyses.
Results: The accuracy, F1-score, AuROC, and normMMC of LightGBM, XGBoost, and Random Forest models were higher than those of other models in both datasets. In both datasets 1 and 2, accuracy, F1-score, AuROC and normMCC of the XGBoost model were the highest among five models (from 0.890 to 1.000). Only Random Forest models had specificity scores higher than 0.850. High scores of sensitivity, accuracy, precision, F1-score, and normMCC indicated that the models were making accurate predictions for datasets 1 and 2.
Conclusion: XGBoost, LightGBM, and Random Forest were the best-performed machine learning models to predict antibiotic resistance of bacterial infections of ICUs patients using the patients' EMRs.
Keywords: LightGBM; XGBoost; antibiotic resistance; machine learning; random forest.
© 2023 Tran Quoc et al.