Assessment of a training project of English as a media of instruction(EMI) using Kirkpatrick model

Wenlan Zhao; Zixian Liu; Tong Wang; Xiaohan Yin; Yanchun Sun; Xuemei Zhang; Hui Yang

doi:10.1186/s12909-023-04204-5

Assessment of a training project of English as a media of instruction(EMI) using Kirkpatrick model

BMC Med Educ. 2023 Apr 20;23(1):271. doi: 10.1186/s12909-023-04204-5.

Authors

Wenlan Zhao¹, Zixian Liu^#², Tong Wang³, Xiaohan Yin⁴, Yanchun Sun⁵, Xuemei Zhang⁵, Hui Yang⁶

Affiliations

¹ Center for Faculty Development, Kunming Medical University, Kunming, China. zhaowenlan@kmmu.edu.cn.
² School of Foreign Languages, Southwestern University of Finance and Economics, Chengdu, China.
³ School of Medicine, Kunming Medical University, Kunming, China.
⁴ Department of Teaching Management, First Affiliated Hospital of Kunming Medical University, Kunming, China.
⁵ Institute of Higher Education Research, Kunming Medical University, Kunming, China.
⁶ Clinical Skill Training Center, Kunming Medical University, Kunming, China.

^# Contributed equally.

Abstract

Background: English as a Media of Instruction (EMI) teacher development project is based upon the framework for teacher Continuing Professional Development (CPD) and aims to effectively improve both the confidence and overall capacity of EMI lecturers. Kunming Medical University(KMU) conducted the EMI training project to improve teachers' competence for MBBS education. This study aimed to assess teachers' changes following the implementation of this training project, via the Kirkpatrick evaluation model.

Methods: A total of trainees (n = 84) were invited as the research objects. The effects of the EMI training project implemented in KMU were evaluated in terms of the reaction, learning, and behavior dimensions based on the Kirkpatrick model. The self-administered online anonymous questionnaires and observations of participants' EMI lectures were administered to all participants to collect the data. Furthermore, to understand participants' perceptions of the management and trainers of the training project, some open-ended questions were required to answer.

Results: Based on 1-3 level of the Kirkpatrick model, all participants were highly satisfied with the EMI training implementation on the reaction level, and expressed positive comments about the management of the training and trainers. On the learning level, participants' scores on awareness of EMI teaching techniques increased significantly(t = 7.122, P < 0.001)with the training process. Concerning the behavior level, the participant's confidence as an EMI instructor increased dramatically at end of the whole training(p < 0.001). Moreover, trainees had applied some EMI skills in class and would like to make some commitment to implement learner-centered learning, to do more practice on EMI techniques.

Conclusion: The findings of this study confirm that EMI training has an effective impact on the competence and confidence of participants as EMI instructors at levels 1-3 of the Kirkpatrick evaluation model. This training may be a potentially beneficial effect on the teaching quality of MBBS education.

Keywords: Continue professional development; English as a media of instruction (EMI) training; Kirkpatrick evaluation model; Medical education.

MeSH terms

Clinical Competence
Curriculum*
Educational Status
Humans
Learning*
Surveys and Questionnaires