Postprocedural Cognitive Load Measurement With Immediate Feedback to Guide Curriculum Development

Abstract

Background: Methods to assess competency in cardiothoracic training are essential. Here, we report a system that allows us to better assess competency from the perspective of both the trainee and educator. We hypothesized that postprocedural cognitive burden measurement (by the trainee) with immediate feedback (from the educator) could aid in identifying barriers to the acquisition of skills and knowledge so that training curricula can be individualized.

Methods: The National Aeronautics and Space Administration Task Load Index (NASA-TLX), a validated instrument to measure cognitive load, was administered with an online platform after bronchoscopy, esophagogastroduodenoscopy, and video-assisted thoracoscopic surgery for 11 residents. Immediate postprocedure feedback and standardized debriefing occurred for each procedure.

Results: Mean NASA-TLX scores were highest (indicating greater cognitive load) for esophagogastroduodenoscopy and video-assisted thoracoscopic surgery (P < .001). When comparing subscale measures, mental demand was significantly higher for video-assisted thoracoscopic surgery (P = .026) compared with the other procedures, whereas physical demand was highest for esophagogastroduodenoscopy (P = .018). Self-reported frustration was similar for all case types (P = .247). Cognitive burden decreased with a greater number of procedures for bronchoscopy (P = .027). Significant improvement was noted by the trainee at the end of the rotation in self-assessed procedural competency and preparedness for thoracic board topics (all P < .05). Postprocedure feedback by the attending surgeon correlated with more frequent completion of self-evaluations by the residents.

Conclusions: Longitudinal assessment of cognitive load in combination with postprocedural feedback identified barriers to skill acquisition for both residents and educators. This information allows for individualized rotation development as a step toward a competency-based curriculum.