Despite the body of research into Zn for human and animal health and productivity, very little work has been done to discern whether this benefit is exerted solely on the host organism, or whether there is some effect of dietary Zn upon the gastrointestinal microbiota, particularly in ruminants. We hypothesized that (i) supplementation with Zn would alter the rumen bacterial community in yearling rams, but that (ii) supplementation with either inorganically sourced ZnSO4, or a chelated Zn AA complex, which was more bioavailable, would affect the rumen bacterial community differently. Sixteen purebred Targhee yearling rams were utilized in an 84-d completely randomized design, and allocated to one of three pelleted dietary treatments: control diet without fortified Zn (~1 × NRC), a diet fortified with a Zn AA complex (~2 × NRC), and a diet fortified with ZnSO4 (~2 × NRC). Rumen bacterial community was assessed using Illumina MiSeq of the V4 to V6 region of the 16S rRNA gene. One hundred and eleven OTUs were found with > 1% abundance across all samples. The genera Prevotella, Solobacterium, Ruminococcus, Butyrivibrio, Olsenella, Atopobium, and the candidate genus Saccharimonas were abundant in all samples. Total rumen bacterial evenness and diversity in rams were reduced by supplementation with a Zn AA complex, but not in rams supplemented with an equal concentration of ZnSO4, likely due to differences in bioavailability between organic and inorganically sourced supplement formulations. A number of bacterial genera were altered by Zn supplementation, but only the phylum Tenericutes was significantly reduced by ZnSO4 supplementation, suggesting that either Zn supplementation formulation could be utilized without causing a high-level shift in the rumen bacterial community which could have negative consequences for digestion and animal health.