Heavy metals that leach from contaminated soils under acid rain are of increasing concern. In this study, simulated acid rain (SAR) was pumped through columns of artificially contaminated purple soil. Column leaching tests and sequential extraction were conducted for the heavy metals Cu, Pb, Cd, and Zn to determine the extent of their leaching as well as to examine the transformation of their speciation in the artificially contaminated soil columns. Results showed that the maximum leachate concentrations of Cu, Pb, Cd, and Zn were less than those specified in the Chinese Quality Standards for Groundwater (Grade IV), thereby suggesting that the heavy metals that leached from the polluted purple soil receiving acid rain may not pose as risks to water quality. Most of the Pb and Cd leachate concentrations were below their detection limits. By contrast, higher Cu and Zn leachate concentrations were found because they were released by the soil in larger amounts as compared with those of Pb and Cd. The differences in the Cu and Zn leachate concentrations between the controls (SAR at pH 5.6) and the treatments (SAR at pH 3.0 and 4.5) were significant. Similar trends were observed in the total leached amounts of Cu and Zn. The proportions of Cu, Pb, Cd, and Zn in the EXC and OX fractions were generally increased after the leaching experiment at three pH levels, whereas those of the RES, OM, and CAR fractions were slightly decreased. Acid rain favors the leaching of heavy metals from the contaminated purple soil and makes the heavy metal fractions become more labile. Moreover, a pH decrease from 5.6 to 3.0 significantly enhanced such effects.