The challenges of seasonal environments are thought to contribute to brain evolution, but in which way is debated. According to the Cognitive Buffer Hypothesis (CBH) brain size should increase with seasonality, as the cognitive benefits of a larger brain should help overcoming periods of food scarcity via, for instance, increased behavioral flexibility. However, in line with the Expensive Brain Framework (EBF) brain size should decrease with seasonality because a smaller brain confers energetic benefits in periods of food scarcity. Empirical evidence is inconclusive and mostly limited to homoeothermic animals. Here we used phylogenetic comparative analyses to test the impact of seasonality on brain evolution across 30 species of anurans (frogs) experiencing a wide range of temperature and precipitation. Our results support the EBF because relative brain size and the size of the optic tectum were negatively correlated with variability in temperature. In contrast, we found no association between the variability in precipitation and the length of the dry season with either brain size or the sizes of other major brain regions. We suggest that seasonality-induced food scarcity resulting from higher variability in temperature constrains brain size evolution in anurans. Less seasonal environments may therefore facilitate the evolution of larger brains in poikilothermic animals.