Non-pharmaceutical interventions to combat COVID-19 transmission have worked to slow the spread of the epidemic but can have high socio-economic costs. It is critical we understand the efficacy of non-pharmaceutical interventions to choose a safe exit strategy. Many current models are not suitable for assessing exit strategies because they do not account for epidemic resurgence when social distancing ends prematurely (e.g., statistical curve fits) nor permit scenario exploration in specific locations. We developed an SEIR-type mechanistic epidemiological model of COVID-19 dynamics to explore temporally variable non-pharmaceutical interventions. We provide an interactive tool and code to estimate the transmission parameter, β, and the effective reproduction number, R eff . We fit the model to Santa Clara County, California, where an early epidemic start date and early shelter-in-place orders could provide a model for other regions. As of April 22, 2020, we estimate an R eff of 0.982 (95% CI: 0.849 - 1.107) in Santa Clara County. After June 1 (the end-date for Santa Clara County shelter-in-place as of April 27), we estimate a shift to partial social distancing, combined with rigorous testing and isolation of symptomatic individuals, is a viable alternative to indefinitely maintaining shelter-in-place. We also estimate that if Santa Clara County had waited one week longer before issuing shelter-in-place orders, 95 additional people would have died by April 22 (95% CI: 7 - 283). Given early life-saving shelter-in-place orders in Santa Clara County, longer-term moderate social distancing and testing and isolation of symptomatic individuals have the potential to contain the size and toll of the COVID-19 pandemic in Santa Clara County, and may be effective in other locations.