Several swine-specific microbial source tracking methods are based on PCR assays targeting Bacteroidales 16S rRNA gene sequences. The limited application of these assays can be explained by the poor understanding of their molecular diversity in fecal sources and environmental waters. In order to address this, we studied the diversity of 9,340 partial (>600 bp in length) Bacteroidales 16S rRNA gene sequences from 13 fecal sources and nine feces-contaminated watersheds. The compositions of major Bacteroidales populations were analyzed to determine which host and environmental sequences were contributing to each group. This information allowed us to identify populations which were both exclusive to swine fecal sources and detected in swine-contaminated waters. Phylogenetic and diversity analyses revealed that some markers previously believed to be highly specific to swine populations are shared by multiple hosts, potentially explaining the cross-amplification signals obtained with nontargeted hosts. These data suggest that while many Bacteroidales populations are cosmopolitan, others exhibit a preferential host distribution and may be able to survive different environmental conditions. This study further demonstrates the importance of elucidating the diversity patterns of targeted bacterial groups to develop more inclusive fecal source tracking applications.