So Many Ways to Be Wrong: Completeness and Accuracy in a Prospective Study of OR-to-ICU Handoff Standardization

Abstract

Background: Studies focused on improving handoffs often measure the quality of information exchange using information completeness without reporting on accuracy. The present investigation aimed to characterize changes in the accuracy of transmitted patient information after standardization of operating room (OR)-to-ICU handoffs.

Methods: Handoffs and Transitions in Critical Care (HATRICC) was a mixed methods study conducted in two US ICUs. From 2014 to 2016, trained observers captured the nature and content of information transmitted during OR-to-ICU handoffs, comparing this to the electronic medical record. Inconsistencies were compared before and after handoff standardization. Semistructured interviews initially conducted for implementation were reanalyzed to contextualize quantitative findings.

Results: A total of 160 OR-to-ICU handoffs were observed-63 before and 97 after standardization. Across seven categories of information, including allergies, past surgical history, and IV fluids, two types of inaccuracy were observed: incomplete information (for example, providing only a partial list of allergies) and incorrect information. Before standardization, an average of 3.5 information elements per handoff were incomplete, and 0.11 were incorrect. After standardization, the number of incomplete information elements per handoff decreased to 2.4 (-1.1, p < 0.001), and the number of incorrect items was similar, at 0.16 (p = 0.54). Interviews revealed that the familiarity of a transporting OR provider (for example, surgeon, anesthetist) with the patient's case was considered an important factor affecting information exchange.

Conclusion: Handoff accuracy improved after standardizing OR-to-ICU handoffs in a two-ICU study. The improvement in accuracy was due to improved completeness rather than a change in the transmission of inaccurate information.