To solve the competition problem of acidophilic bacteria and sulfate-reducing bacteria in the practical application of mine tailing bioremediation, research into the mechanisms of using different nutrients to adjust the microbial community was conducted. Competition experiments involving acidophilic bacteria and sulfate-reducing bacteria were performed by supplementing the media with yeast extract, tryptone, lactate, and glucose. The physiochemical properties were determined, and the microbial community structure and biomass were investigated using MiSeq sequencing and qRT-PCR, respectively. Four nutrients had different remediation mechanisms and yielded different remediation effects. Yeast extract and tryptone (more than 1.6 g/L) promoted sulfate-reducing bacteria and inhibited acidophilic bacteria. Lactate inhibited both sulfate-reducing and acidophilic bacteria. Glucose promoted acidophilic bacteria more than sulfate-reducing bacteria. Yeast extract was the best choice for adjusting the microbial community and bioremediation, followed by tryptone. Lactate kept the physiochemical properties stable or made slight improvements; however, glucose was not suitable for mine tailing remediation. Different nutrients had significant effects on the abundance of the second enzyme of the sulfate-reducing pathway (p < 0.05), which is the rate-limiting step of sulfate-reducing pathways. Nutrients changed the remediation effects effectively by adjusting the microbial community and the abundance of the sulfate-reducing rate-limiting enzyme.