White-tailed deer are a culturally and economically important game species in North America, especially in South Texas. The recent discovery of chronic wasting disease (CWD) in captive deer facilities in Texas has increased concern about the potential emergence of CWD in free-ranging deer. The concern is exacerbated because much of the South Texas region is a semi-arid environment with variable rainfall, where precipitation is strongly correlated with fawn recruitment. Further, the marginally productive rangelands, in combination with erratic fawn recruitment, results in populations that are frequently density-independent, and thus sensitive to additive mortality. It is unknown how a deer population in semi-arid regions would respond to the presence of CWD. We used long-term empirical datasets from a lightly harvested (2% annual harvest) population in conjunction with 3 prevalence growth rates from CWD afflicted areas (0.26%, 0.83%, and 2.3% increases per year) via a multi-stage partially deterministic model to simulate a deer population for 25 years under four scenarios: 1) without CWD and without harvest, 2) with CWD and without harvest, 3) with CWD and male harvest only, and 4) with CWD and harvest of both sexes. The modeled populations without CWD and without harvest averaged a 1.43% annual increase over 25 years; incorporation of 2% annual harvest of both sexes resulted in a stable population. The model with slowest CWD prevalence rate growth (0.26% annually) without harvest resulted in stable populations but the addition of 1% harvest resulted in population declines. Further, the male age structure in CWD models became skewed to younger age classes. We incorporated fawn:doe ratios from three CWD afflicted areas in Wisconsin and Wyoming into the model with 0.26% annual increase in prevalence and populations did not begin to decline until ~10%, ~16%, and ~26% of deer were harvested annually. Deer populations in variable environments rely on high adult survivorship to buffer the low and erratic fawn recruitment rates. The increase in additive mortality rates for adults via CWD negatively impacted simulated population trends to the extent that hunter opportunity would be greatly reduced. Our results improve understanding of the potential influences of CWD on deer populations in semi-arid environments with implications for deer managers, disease ecologists, and policy makers.