Inter-rater reliability of the Silverman and Andersen index-a measure of respiratory distress in preterm infants

PLoS One. 2023 Jun 30;18(6):e0286655. doi: 10.1371/journal.pone.0286655. eCollection 2023.

Abstract

Background: There are various methods of respiratory support available to optimize respiratory function in preterm infants. Respiratory scoring tools might provide information on which method to choose and the level and duration of support needed. Before implementing a respiratory scoring tool in our clinical practice, we aimed to test the inter- and intra-rater reliability of the Silverman and Andersen index (SA index) among neonatologists and nurses when applied to preterm infants on respiratory support. We also examined the association between the SA index and the electrical activity of the diaphragm (Edi signals).

Methods: This was a multicenter study including three newborn intensive care units in Norway. Four neonatologists and 10 nurses applied the SA index when assessing 80 videos of 44 preterm infants on High Flow Nasal Cannula, Continuous Positive Airway Pressure and Neurally Adjusted Ventilatory Assist. The inter- and intra-rater reliability for the sum scores were measured by the intra-class correlation coefficient (ICC), and Kendall's W was used to assess the degree of agreement for each item. We quantified the association between the Edi signals and the SA index scores by the Spearman's correlation coefficient.

Results: We found poor inter-rater reliability with an ICC for absolute agreement of 0.34 (95% CI: 0.20 to 0.53). There was fair agreement measuring each item separately for upper chest movements (Kendall's W 0.30), and moderate for lower chest movements (0.43) and xiphoid retractions (0.44). Expiratory grunting showed substantial agreement (0.67). The intra-rater reliability was good (ICC for absolute agreement 0.77; 95% CI: 0.68 to 0.84). We found a moderate positive correlation (r = 0.468, p = 0.028) between the maximum inspiratory diaphragm activity (Edi peak) and the mean inspiratory SA index scores.

Conclusion: Our study showed poor inter-rater and good intra-rater reliability of the SA index when nurses and neonatologists assessed videos of preterm infants on various types of respiratory support. Edi peak and SA index had a moderate positive correlation. Formal training might be essential to improve the inter-rater reliability.

Trial registration: Registered 26th June 2017, ClinicalTrials.gov Identifier: NCT03199898.

Publication types

  • Multicenter Study
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Dyspnea
  • Humans
  • Infant
  • Infant, Newborn
  • Infant, Premature*
  • Reproducibility of Results
  • Respiration
  • Respiratory Distress Syndrome*

Associated data

  • ClinicalTrials.gov/NCT03199898

Grants and funding

This project has been made possible by a PhD grant from the Research and Innovation Department in Central Norway Regional Health Authority Registration number 26264 http://forskningsmidler.ihelse.net/nb-no/Soknader/Soknad/Visning/26264/8fc1b917 and Stiftelsen DAM. Registration number (2017/HE1-160037) https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=8&ved=2ahUKEwizx87785r2AhXkmIsKHSFVBa4QFnoECAkQAQ&url=https%3A%2F%2Fdam.no%2Fprogrammer%2Fforskning%2Fom-programmet%2F&usg=AOvVaw3qrvHt1l6o9a1zhrBXbZjq The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.