Predicting bacterial infections among pediatric cancer patients with febrile neutropenia: External validation of the PICNICC model

Pediatr Blood Cancer. 2018 Apr;65(4). doi: 10.1002/pbc.26935. Epub 2017 Dec 29.

Abstract

Introduction: The Predicting Infectious Complications in Neutropenic Children and Young People with Cancer (PICNICC) model was recently developed for antibiotic stewardship among pediatric cancer patients, but limited information is available about its clinical usefulness. We aimed to assess the performance of the PICNICC model for predicting microbiologically documented bacterial infections among pediatric cancer patients with febrile neutropenia.

Materials and methods: We used data for febrile neutropenia episodes at a pediatric cancer center in Aarhus, Denmark between 2000 and 2016. We assessed the area under the receiver operating characteristic curve (AUC), calibration, and clinical usefulness (i.e., net benefit). We also recalibrated the model using statistical updating methods.

Results: We observed 306 microbiologically documented bacterial infections among 1,892 episodes of febrile neutropenia. The AUC of the model was 0.73 (95% confidence limits [CL]: 0.71-0.75). The calibration intercept (calibration-in-the-large) was -0.69 (95% CL: -0.86 to -0.51) and the slope was 0.77 (95% CL: 0.65-0.89). Modest net benefit was observed at a decision threshold of 5%. Recalibration improved calibration but did not improve net benefit.

Conclusions: The PICNICC model has potential for reducing unnecessary antibiotic exposure for pediatric cancer patients with febrile neutropenia, but continued validation and refinement is necessary to optimize clinical usefulness.

Keywords: antibiotics; bacterial infection; clinical prediction model; febrile neutropenia; pediatric cancer; validation.

Publication types

  • Clinical Trial
  • Research Support, Non-U.S. Gov't
  • Validation Study

MeSH terms

  • Anti-Bacterial Agents / administration & dosage*
  • Bacterial Infections* / drug therapy
  • Bacterial Infections* / epidemiology
  • Bacterial Infections* / etiology
  • Child
  • Child, Preschool
  • Febrile Neutropenia* / epidemiology
  • Febrile Neutropenia* / therapy
  • Female
  • Humans
  • Infant
  • Male
  • Models, Biological*
  • Neoplasms* / epidemiology
  • Neoplasms* / therapy
  • Predictive Value of Tests

Substances

  • Anti-Bacterial Agents