Introduction: Khesar Gyalpo University of Medical Sciences of Bhutan, established in 2014, has ushered in a new era in medical education in Bhutan. Multiple Choice Questions are a common means of written assessment in medical education.
Methods: This was a quasi-experimental study conducted at the Faculty of Postgraduate Medicine, KGUMSB, Thimphu in December 2016. A total of 8 MCQs were prepared by four teaching faculties from different fields who had no prior training on construction of MCQs. It was delivered to a group of 16 randomly selected intern doctors. A 2 hours long workshop on construction of MCQs was conducted. After the workshop, the same MCQs were modified according to standard guidelines on developing MCQs and were tested in the same group of intern doctors. An analysis on the performance, difficulty factor, discrimination index and distractor analysis was done on the two sets of MCQs using Microsoft Excel and SPSS 20.0.
Results: For the pre- and post-workshop questions respectively, the pass percentage was 69.8% (11) and 81.3% (13), difficulty factor was 0.51 and 0.53, discrimination index was 0.59 and 0.47, distractor effectiveness was 83.3% and 74.9%.
Conclusions: The workshop on MCQ development apparently seemed highly valuable and effective in changing the learning and performances of medical educators in the development of MCQs.
Keywords: difficulty factor; discrimination index; faculty development; medical education..