Global water shortage is becoming increasingly severe, so the identification and protection of potential areas for harvesting water play important roles in alleviating drought. Suitable sites for potential water harvesting require a high runoff potential. Avoiding soil erosion caused by high surface runoff, however, is also necessary. We therefore developed a procedure for the continuous accounting of runoff potential based on the Soil Conservation Service curve number and potential risks of water and soil loss based on the universal soil loss equation to evaluate the potential for water harvesting. Suitable sites for rainwater harvesting covered 24.90% of the semi-arid area of Chifeng, southeastern Inner Mongolia, China. The best areas accounted for 8.4% of the study area. The southern part of the Greater Hinggnan Mountains in northern Chifeng had a large rainwater harvesting area, and the western and eastern parts of the Chifeng area belonging to Horqin Sandy Land and Hunshandake Sandy Land, respectively, had smaller rainwater-harvesting areas. The eight reservoirs in the Xilamulun River Basin were further analyzed as an example. Derived sites investigated by ground-truth field verification indicated a method accuracy of 87.5%. This methodology could be effective in other areas with similar requirements due to the increasing demand for water resources and requirements for the protection of soil-water resources.