Background: In 2015, the College of Nurses of Ontario, replaced the Canadian Registered Nurse Examination with the NCLEX-RN exam as entry-to-practice. Faculty in a college-university partnership searched for products to provide nursing students with focused practice in writing exams modelled on the Canadian NCLEX-RN test plan.
Purpose: The aim of this three-phased evaluation study was to test and validate NCLEX-RN exam preparation materials newly developed for the Canadian context.
Methods: A mixed methods descriptive design was used to capture subjective perspectives and objective measures. After ethical approval was obtained, 13 students assessed the e-learning platform's usability. Eight faculty/clinical experts assessed the content validity of materials using a content validity index (CVI) at both item (I-CVI), and scale (S-CVI) levels. Lastly, 72 completed tests served as the basis for assessing psychometric properties of selected test items.
Results: Materials were assessed as useful and easy to use and navigate. I-CVIs ranged between 0.5 to 1.0 with none falling below 0.5 while S-CVIs were above the standard for acceptability of greater than 0.8 with none falling below 0.9. Overall test reliability measured by the Kuder-Richardson formula was 0.73. Many items assessed for difficulty (64%) showed a proportion of correct responses within desired ranges, and most point-biserial indices ranged from fair to very good.
Conclusion: Strong evidence supported the usability and content validity of the materials assessed. Item difficulty and discrimination analyses were within acceptable ranges. Suggestions for improvements were offered. Predictive analysis should form the basis of future research in this area.
Keywords: NCLEX-RN exam preparation; NCLEX-RN exam resources; content validity; entry-to-practice; item difficulty; usability.