Land degradation is one of the severe environmental problems in China. In order to combat land degradation, a soil conservation program was introduced since 2000 to reduce soil erosion by converting slope-cultivated land into forestry and pasture. This paper represents the first systematic attempt to investigate the impact of the soil conservation program on land degradation in the loess plateau. The results indicate that the soil conservation program to convert slope fields into forest or pasture is an effective way to combat soil erosion. However, a subsidy that is higher than profit of land use activity of slope fields before their conversion into forest and pasture is needed to encourage farmers to join the conservation program. A policy measure to encourage and assist farmers to develop sedentary livestock by using crops produced from fields as well as fodder and forage grass from the converted slope fields might contribute to combat soil erosion. Increase in off-farm job opportunities may encourage households to reduce cultivation in slope fields. That implies a policy measure to encourage rural urbanization might contribute to combat soil erosion.