Development and validation of a multiple choice examination assessing cognitive and behavioural knowledge of pediatric resuscitation: a report from the EXPRESS pediatric research collaborative

Abstract

Introduction: Assessing the knowledge of Pediatric Advanced Life Support (PALS) based learning objectives of medical trainees is an important evaluation component for both residency programs and for research studies. In this study, a multiple-choice question (MCQ) examination was developed and validated for use in a larger pediatric simulation resuscitation study (EXPRESS study).

Methods: Experts in pediatric resuscitation developed two MCQ exams using a set of pre-determined learning objectives. After a single center pilot, the exam was used as an assessment of cognitive skills in the EXPRESS study, a multicenter trial examining the use of scripted debriefing and high-fidelity simulation in pediatric resuscitation education. Results from the MCQ in the pre-intervention phase of the EXPRESS study were used to assess the reliability and validity of the MCQ examination. In addition, an Exploratory Factor Analysis (EFA) was carried to assess the underlying structure of the PALS-based learning objectives.

Results: 435 health care professionals completed the MCQ examination with an average score of 69.3%. Significantly higher examination results were seen in physicians vs. non-physicians, senior vs. junior physicians and participants with up-to-date PALS certification. The EFA results indicated four distinct categories of items were assessed.

Conclusion: This short MCQ examination demonstrated reasonable reliability and construct validity. It may be useful to assess pediatric resuscitation knowledge in future studies or courses.