Where experience makes a difference: teachers' judgment accuracy and diagnostic reasoning regarding student learning characteristics

Abstract

The concept of teacher professional vision suggests that experienced teachers, compared to novice teachers, might be better at making accurate judgments of students' learning characteristics, which can be explained by their advanced reasoning in diagnostic situations. This study examines experienced and novice teachers' diagnoses of different student characteristic profiles: three inconsistent profiles (overestimating, uninterested, and underestimating) and two consistent profiles (strong and struggling). We examined both experienced (n = 19 in-service mathematics teachers) and novice teachers (n = 24 pre-service mathematics teachers) to determine the extent of differences in their judgment accuracy and their diagnostic reasoning about observable cues when diagnosing student profiles while watching a lesson video. ANOVA results indicate that experienced teachers generally achieved a higher judgment accuracy in diagnosing student profiles compared to novice teachers. Moreover, epistemic network analysis of observable cues in experienced and novice teachers' diagnostic reasoning showed that, compared to novice teachers, experienced teachers make more relations between a broader spectrum of both surface cues (e.g., a student's hand-raising behavior) and deep cues (e.g., a student being interested in the subject). Experienced teachers thereby construct more comprehensive and robust reasoning compared to novice teachers. The findings highlight how professional experience shapes teachers' professional skills, such as diagnosing, and suggest strategies for enhancing teacher training.

Keywords: expert-novice comparison; judgment accuracy; noticing; professional vision; reasoning; student characteristics.