Phenological events, such as the timing of flowering or insect emergence, are influenced by a complex combination of climatic and non-climatic factors. Although temperature is generally considered most important, other weather events such as frosts and precipitation events can also influence many species' phenology. Non-climatic variables such as photoperiod and site-specific habitat characteristics can also have important effects on phenology. Forecasting phenological shifts due to climate change requires understanding and quantifying how these multiple factors combine to affect phenology. However, current approaches to analyzing phenological data have a limited ability for quantifying multiple drivers simultaneously. Here, we use a novel statistical approach to estimate the combined effects of multiple variables, including local weather events, on the phenology of several taxa (a tree, an insect, and a fungus). We found that thermal forcing had a significant positive effect on each species, frost events delayed the phenology of the tree and butterfly, and precipitation had a positive effect on fungal fruiting. Using data from sites across latitudinal gradients, we found that these effects are remarkably consistent across sites once latitude and other site effects are accounted for. This consistency suggests an underlying biological response to these variables that is not commonly estimated using data from field observations. This approach's flexibility will be useful for forecasting ongoing phenological responses to changes in climate variability in addition to seasonal trends.