Phosphorus was added as a nutrient to bench-scale and pilot-scale biologically active carbon (BAC) reactors operated for perchlorate and nitrate removal from contaminated groundwater. The two bioreactors responded similarly to phosphorus addition in terms of microbial community function (i.e., reactor performance), while drastically different responses in microbial community structure were detected. Improvement in reactor performance with respect to perchlorate and nitrate removal started within a few days after phosphorus addition for both reactors. Microbial community structures were evaluated using molecular techniques targeting 16S rRNA genes. Clone library results showed that the relative abundance of perchlorate-reducing bacteria (PRB) Dechloromonas and Azospira in the bench-scale reactor increased from 15.2% and 0.6% to 54.2% and 11.7% after phosphorus addition, respectively. Real-time quantitative PCR (qPCR) experiments revealed that these increases started within a few days after phosphorus addition. In contrast, after phosphorus addition, the relative abundance of Dechloromonas in the pilot-scale reactor decreased from 7.1 to 0.6%, while Zoogloea increased from 17.9 to 52.0%. The results of this study demonstrated that similar operating conditions for bench-scale and pilot-scale reactors resulted in similar contaminant removal performances, despite dramatically different responses from microbial communities. These findings suggest that it is important to evaluate the microbial community compositions inside bioreactors used for drinking water treatment, as they determine the microbial composition in the effluent and impact downstream treatment requirements for drinking water production. This information could be particularly relevant to drinking water safety, if pathogens or disinfectant-resistant bacteria are detected in the bioreactors.