Under paddy field conditions, biological sulfur oxidation occurs in the oxidized surface soil layer and rhizosphere, in which oxygen leaks from the aerenchyma system of rice plants. In the present study, we examined community shifts in sulfur-oxidizing bacteria associated with the oxidized surface soil layer and rice roots under different sulfur fertilization conditions based on the 16S ribosomal RNA (rRNA) gene in order to explore the existence of oligotrophic sulfur-oxidizing bacteria in the paddy rice ecosystem. Rice plants were grown in pots with no fertilization (control) or CaCO3 or CaSO4 fertilization. A principal-coordinates analysis (PCoA) showed that CaSO4 fertilization markedly affected bacterial communities associated with rice roots and soil, whereas no significant differences were observed in plant growth among the fertilizer treatments examined. In rice roots, the relative abundance of Acidobacteria, Alphaproteobacteria, Gammaproteobacteria, and TM7 was significantly higher in CaSO4-fertilized pots than in control pots. Alphaproteobacteria, Bradyrhizobiaceae, and Methylocystaceae members were significantly more abundant in CaSO4-fertilized roots than in control roots. On the other hand, the abundance of Actinobacteria and Proteobacteria was lower in CaSO4-fertilized soil than in control soil. These results indicate that the bacteria associated with rice roots and soil responded to the sulfur amendment, suggesting that more diverse bacteria are involved in sulfur oxidation in the rice paddy ecosystem than previously considered.