Reliability and criterion-related validity testing (construct) of the Endotracheal Suction Assessment Tool (ESAT©)

Kylie Davies; Max K Bulsara; Anne-Sylvie Ramelet; Leanne Monterosso

doi:10.1111/jocn.14269

Reliability and criterion-related validity testing (construct) of the Endotracheal Suction Assessment Tool (ESAT©)

J Clin Nurs. 2018 May;27(9-10):1891-1900. doi: 10.1111/jocn.14269.

Authors

Kylie Davies^{1

2}, Max K Bulsara^{3

4

5}, Anne-Sylvie Ramelet⁶, Leanne Monterosso^{7

8

9}

Affiliations

¹ University of Notre Dame Australia, Fremantle, WA, Australia.
² Paediatric Intensive Care Unit, Princess Margaret Hospital for Children, Subiaco, WA, Australia.
³ School of Population Health, Institute of Health and Rehabilitation Research, University of Notre Dame Australia, Fremantle, WA, Australia.
⁴ School of Population Health, University of Western Australia, Crawley, WA, Australia.
⁵ University College London, London, UK.
⁶ Faculty of Biology and Medicine, Institute of Higher Education and Research in Healthcare, University of Lausanne, Lausanne, Switzerland.
⁷ School of Nursing and Midwifery, University of Notre Dame Australia, Fremantle, WA, Australia.
⁸ St John of God Murdoch Hospital, Murdoch, WA, Australia.
⁹ School of Nursing and Midwifery, Edith Cowan University, Joondalup, WA, Australia.

PMID: 29345013
DOI: 10.1111/jocn.14269

Abstract

Aims and objectives: To establish criterion-related construct validity and test-retest reliability for the Endotracheal Suction Assessment Tool© (ESAT©).

Background: Endotracheal tube suction performed in children can significantly affect clinical stability. Previously identified clinical indicators for endotracheal tube suction were used as criteria when designing the ESAT©. Content validity was reported previously. The final stages of psychometric testing are presented.

Design: Observational testing was used to measure construct validity and determine whether the ESAT© could guide "inexperienced" paediatric intensive care nurses' decision-making regarding endotracheal tube suction. Test-retest reliability of the ESAT© was performed at two time points.

Methods: The researchers and paediatric intensive care nurse "experts" developed 10 hypothetical clinical scenarios with predetermined endotracheal tube suction outcomes. "Experienced" (n = 12) and "inexperienced" (n = 14) paediatric intensive care nurses were presented with the scenarios and the ESAT© guiding decision-making about whether to perform endotracheal tube suction for each scenario. Outcomes were compared with those predetermined by the "experts" (n = 9). Test-retest reliability of the ESAT© was measured at two consecutive time points (4 weeks apart) with "experienced" and "inexperienced" paediatric intensive care nurses using the same scenarios and tool to guide decision-making.

Results: No differences were observed between endotracheal tube suction decisions made by "experts" (n = 9), "inexperienced" (n = 14) and "experienced" (n = 12) nurses confirming the tool's construct validity. No differences were observed between groups for endotracheal tube suction decisions at T1 and T2.

Conclusion: Criterion-related construct validity and test-retest reliability of the ESAT© were demonstrated. Further testing is recommended to confirm reliability in the clinical setting with the "inexperienced" nurse to guide decision-making related to endotracheal tube suction.

Relevance to clinical practice: The ESAT© is the first validated tool to systematically guide endotracheal nursing practice for the "inexperienced" nurse.

Keywords: clinical indicators; endotracheal tube suction; nurses; paediatric intensive care; reliability; validity.

Publication types

Validation Study

MeSH terms

Child
Clinical Nursing Research
Critical Care Nursing / standards
Decision Making
Female
Humans
Intubation, Intratracheal / standards*
Psychometrics
Reproducibility of Results
Respiration, Artificial / nursing*
Suction / standards*