Recent studies have shown that continuous cropping in soybean causes substantial changes to the microbial community in rhizosphere soil. In this study, we investigated the effects of continuous cropping for various time periods on the diversity of rhizosphere soil arbuscular mycorrhizal (AM) fungi in various soybean cultivars at the branching stage. The soybean cultivars Heinong 37 (an intermediate cultivar), Heinong 44 (a high-fat cultivar) and Heinong 48 (a high-protein cultivar) were seeded in a field and continuously cropped for two or three years. We analyzed the diversity of rhizosphere soil AM fungi of these soybean plants at the branching stage using morphological and denaturing gradient gel electrophoresis (DGGE) techniques. The clustering analysis of unweighted pair-group method with arithmetic averages (UPGMA) was then used to investigate the AM fungal community shifts. The results showed that increasing the number of years of continuous cropping can improve the colonization rate of AM fungi in different soybean cultivars at the branching stage. The dominant AM fungi in the experimental fields were Funneliformismosseae and Glomus spp. The number of years of continuous cropping and the soybean cultivar both had obvious effects on the diversity of AM fungi, which was consistent with the results of colonization rate analysis. This study establishes a basis for screening dominant AM fungi of soybean. In addition, the results of this study may be useful for the development of AM fungal inoculants.