Background: Recent research has highlighted the potential for out-of-school-time (OST) environments to impact children's energy balance. Expanding upon this evidence requires validated measures to assess nutrition and physical activity (PA) environments across large samples of OST programs. The aim of this study was to assess the criterion validity of the Out-of-School-Time Snacks, Beverages, and Physical Activity Questionnaire (OST-SBPA), an online questionnaire designed to measure OST nutrition and PA environments by program leaders' reports.
Methods: The study consisted of two samples of OST programs (total n=65). Objective data across program meetings were compared to program leaders' reports of usual snack, beverage, and PA offerings. All 65 programs provided snack and beverage data; PA data were available from 31 programs. Validity was assessed using percent agreement, Cohen's kappa, and Spearman's correlations.
Results: All OST-SBPA items demonstrated agreement above 60% when dichotomized (e.g., none/some versus most/all of the time for frequency items). Most OST-SBPA items were significantly correlated with objective data, including how often fresh and processed fruits and vegetables, salty snacks, sweet snacks, protein snacks, milk, juice, and sweetened beverages were offered and four PA measures (r=0.43-0.78; p<0.01), whereas one item, the frequency that water was offered, was not (r=0.13; p=0.37). The water item demonstrated validity once water from water fountains was recoded and not considered a program-provided beverage.
Conclusions: These findings fill a gap in the literature through the validation of a brief questionnaire that can be used to assess OST nutrition and PA environments. The current results support the use of the OST-SBPA in studies aiming to assess and impact these environments.