We studied microbial communities in two paddy soils, which did not receive nitrogen fertilization and were distinguished by the soil properties. The two microbial communities differed in the relative abundance of gram-negative bacteria and total microbial biomass. Variability in microbial communities between the two fields was related to the levels of phosphorus and soil moisture. Redundancy analysis for individual soils showed that the bacterial community dynamics in the high-yield soil were significantly correlated with total carbon, moisture, available potassium, and pH, and those in the low-yield cores were shaped by pH, and nitrogen factors. Biolog Eco-plate data showed a more active microbial community in the high yield soil. The variations of enzymatic activities in the two soils were significantly explained by total nitrogen, total potassium, and moisture. The enzymatic variability in the low-yield soil was significantly explained by potassium, available nitrogen, pH, and total carbon, and that in the high-yield soil was partially explained by potassium and moisture. We found the relative abundances of Gram-negative bacteria and Actinomycetes partially explained the spatial and temporal variations of soil enzymatic activities, respectively. The high-yield soil microbes are probably more active to modulate soil fertility for rice production.