Since the late 1970s, Southern Hemisphere semi-arid regions such as southern-coastal Chile, southern Africa, and southeastern Australia have experienced a drying trend in austral autumn, predominantly during April and May. The rainfall reduction coincides with a poleward expansion of the tropical belt and subtropical dry zone by around 2°-3° in the same season. This has raised questions as to whether the regional rainfall reductions are attributable to this poleward expansion. Here we show that the impact of the poleward subtropical dry-zone shift is not longitudinally uniform: a clear shift occurs south of Africa and across southern Australia, but there is no evidence of a poleward shift in the southern Chilean sector. As such, a poleward shift of climatological April-May rainfall can explain most of the southeastern Australia rainfall decline, a small portion of the southern Africa rainfall trend, but not the autumn drying over southern Chile.