In post-Fukushima Japan, radiation education is very important, and the subject is being actively discussed. However, little information is available about the amount of knowledge students initially had about radiation or about how well radiation education improves their understanding. Using the questionnaire results of 717 students completed before and after radiation lectures held in three high schools in Fukushima, we examined the number of answers to the questionnaire aligned with the evidence base, and classified the students into clusters based on radiation-related behavior and attitudes to assess the effectiveness of the lecture. The contents of the lectures consisted of (i) scientific knowledge relating to radiation, (ii) results of radiation examinations conducted locally following the disaster and (iii) measures and precautions for daily radiation protection. Associations between the type of knowledge and radiation-related behavior and attitude were also examined to determine which type of knowledge was more important for deepening students' understanding of radiation. This study revealed that radiation education in high schools was effective for students with respect to acquiring relevant basic and practical knowledge; however, the effects of the radiation lecture differed greatly between schools, presumably due to differences in the delivery and atmosphere of the lecture. The present study also suggested that radiation education may positively transform student attitudes and behaviors related to radiation. To enable such a change in awareness, the acquisition of scientific knowledge is essential, for it enables individuals to make better decisions about important matters in their daily lives.