The purpose of this study is to develop an instrument to assess civic scientific literacy measurement (SLiM), based on media coverage. A total of 50 multiple-choice items were developed based on the most common scientific terms appearing in media within Taiwan. These questions covered the subjects of biology (45.26%, 22 items), earth science (37.90%, 19 items), physics (11.58%, 6 items) and chemistry (5.26%, 3 items). A total of 1034 students from three distinct groups (7th graders, 10th graders, and undergraduates) were invited to participate in this study. The reliability of this instrument was 0.86 (KR 20). The average difficulty of the SLiM ranged from 0.19 to 0.91, and the discrimination power was 0.1 to 0.59. According to participants' performances on SLiM, it was revealed that 10th graders (Mean = 37.34±0.23) performed better than both undergraduates (Mean = 33.00±0.33) and 7th graders (Mean = 26.73±0.45) with significant differences in their SLiM.
Keywords: assessment; media; scientific literacy; term extraction; textbooks.