Background: The school environment can play an important role in the prevention of childhood overweight and obesity. Photos of the school environment may contribute to more adequate measurement of the school environment, as photos can be rated by different assessors. We aimed to examine the interrater reliability for rating characteristics of primary school environments related to physical activity and eating.
Methods: Photos taken at 172 primary schools in 7 European countries were rated according to a standardized protocol. Briefly, after categorizing all photos in subsections of physical activity or eating opportunities, 2 researchers independently rated aspects of safety, functionality, aesthetics, type of food/drinks advertised, type/variety of foods provided. Interrater reliability was assessed using the intraclass correlation coefficient (ICC) and Cohen's kappa.
Results: Six subsections of the photo-rating instrument showed excellent (ICC or Cohen's kappa ≥0.81) or good (ICC or Cohen's kappa 0.61 to 0.80) interrater reliability. Outdoor physical activity facilities (ICC = 0.54) showed moderate, and school canteens (Cohen's kappa = 0.05) and vending machines showed poor (Cohen's kappa = 0.16) interrater reliability.
Conclusion: Interrater reliability of the ENERGY (EuropeaN Energy balance Research to prevent excessive weight Gain among Youth) photo-rating instrument was good-to-excellent for 6 out of 9 characteristics of primary school environment components related to physical activity and eating.