Relevance of Deployment Experience and Clinical Practice Characteristics on Military Critical Care Air Transport Team Readiness: A Study of Simulation Construct Validity

Daniel J Brown; Lane Frasier; F Eric Robinson; Mark Cheney; William T Davis; Ann Salvator; Mark Andresen; Melissa Proctor; Ryan Earnest; Timothy Pritts; Richard Strilka

doi:10.1093/milmed/usac142

Relevance of Deployment Experience and Clinical Practice Characteristics on Military Critical Care Air Transport Team Readiness: A Study of Simulation Construct Validity

Mil Med. 2022 May 27:usac142. doi: 10.1093/milmed/usac142. Online ahead of print.

Authors

Daniel J Brown^{1

2

3}, Lane Frasier⁴, F Eric Robinson⁵, Mark Cheney^{3

6}, William T Davis⁷, Ann Salvator⁸, Mark Andresen³, Melissa Proctor³, Ryan Earnest^{3

4}, Timothy Pritts⁴, Richard Strilka^{3

4}

Affiliations

¹ Department of Emergency Medicine, Wright State University, Dayton, OH 45324, USA.
² Department of Emergency Medicine, University of Cincinnati, Cincinnati, OH 45219, USA.
³ Center for Sustainment of Trauma and Readiness Skills, University of Cincinnati, Cincinnati, OH 45219, USA.
⁴ Department of Surgery, University of Cincinnati, Cincinnati, OH 45219, USA.
⁵ Department of Acceleration and Sensory Sciences, Naval Medical Research Unit Dayton, Wright-Patterson AFB, OH 45433, USA.
⁶ Department of Anesthesiology, University of Cincinnati, Cincinnati, OH 45219, USA.
⁷ The En Route Care Research Center, United States Air Force En Route Care Research Center/59th MDW/Science and Technology, Fort Sam Houston, TX 78234, USA.
⁸ Air Force Research Laboratory Airman Biosciences Division, Dayton, OH 45433, USA.

PMID: 35639920
DOI: 10.1093/milmed/usac142

Abstract

Introduction: The Critical Care Air Transport Team (CCATT) Advanced course utilizes fully immersive high-fidelity simulations to train CCATT personnel and assess their readiness for deployment. This study aims to (1) determine whether these simulations correctly discriminate between students with previous deployment experience ("experienced") and no deployment experience ("novices") and (2) examine the effects of students' clinical practice environment on their performance during training simulations.

Materials and methods: Critical Care Air Transport Team Advanced student survey data and course status (pass/no pass) between March 2006 and April 2020 were analyzed. The data included students' specialty, previous exposure to the CCATT Advanced course, previous CCATT deployment experience, years in clinical practice (<5, 5-15, and >15 years), and daily practice of critical care (yes/no), as well as a description of the students' hospital to include the total number of hospital (<100, 100-200, 201-400, and >400) and intensive care unit (0, 1-10, 11-20, and >20) beds. Following descriptive analysis and comparative tests, multivariable regression was used to identify the predictors of passing the CCATT Advanced course.

Results: A total of 2,723 surveys were analyzed: 841 (31%) were physicians (MDs), 1,035 (38%) were registered nurses, and 847 (31%) were respiratory therapists (RTs); 641 (24%) of the students were repeating the course for sustainment training and 664 (24%) had previous deployment experience. Grouped by student specialty, the MDs', registered nurses', and RTs' pass rates were 92.7%, 90.6%, and 85.6%, respectively. Multivariable regression results demonstrated that deployment experience was a robust predictor of passing. In addition, the >15 years in practice group had a 47% decrease in the odds of passing as compared to the 5 to 15 years in practice group. Finally, using MDs as the reference, the RTs had a 61% decrease in their odds of passing. The daily practice of critical care provided a borderline but nonsignificant passing advantage, whereas previous CCATT course exposure had no effect.

Conclusion: Our primary result was that the CCATT Advanced simulations that are used to evaluate whether the students are mission ready successfully differentiated "novice" from "experienced" students; this is consistent with valid simulation constructs. Finally, novice CCATT students do not sustain their readiness skills during the period between mandated refresher training.

Published by Oxford University Press on behalf of the Association of Military Surgeons of the United States 2022. This work is written by (a) US Government employee(s) and is in the public domain in the US.