Studying the spatial distribution pattern of soil organic carbon and its influencing factors is essential for understanding the carbon cycle in terrestrial ecosystems. Soil samples from four active layers of typical vegetation types (Populus, subalpine shrubs, Picea crassifolia Kom, and alpine meadow) in the upper reaches of Shiyang River basin in the Qilian Mountains were collected to determine the soil organic carbon content and physicochemical properties. The results show the following: (1) There are significant differences in the vertical distribution of Soil organic carbon in the watershed, and the Soil organic carbon content decreases significantly with increasing soil depth. (2) Mainly affected by biomass, the organic carbon content of different vegetation types in different soil layers is as follows: Alpine meadow > Picea crassifolia Kom > Populus > Subalpine shrub, and the soil organic carbon content increases with increasing altitude. Under different vegetation types, the Soil organic content is the highest in the 0-30 cm soil profile, and the maximum value often appears in the 0-10 cm layer, then gradually decreases downward. (3) When soil organic carbon is determined in different vegetation types in the study area, the change of hydrothermal factors has little effect on soil organic carbon content in the short term.