The rumen microbial ecosystem is a complex system where rumen fermentation processes involve interactions among microorganisms. There are important relationships between diet and the ruminal bacterial composition. Thus, we investigated the ruminal fermentation characteristics and compared ruminal bacterial communities using tag amplicon pyrosequencing analysis in Yanbian yellow steers, which were fed linseed oil (LO) and propionate precursors. We used eight ruminally cannulated Yanbian yellow steers (510 ± 5.8 kg) in a replicated 4 × 4 Latin square design with four dietary treatments. Steers were fed a basal diet that comprised 80% concentrate and 20% rice straw (DM basis, CON). The CON diet was supplemented with LO at 4%. The LO diet was also supplemented with 2% dl-malate or 2% fumarate as ruminal precursors of propionate. Dietary supplementation with LO and propionate precursors increased ruminal pH, total volatile fatty acid concentrations, and the molar proportion of propionate. The most abundant bacterial operational taxonomic units in the rumen were related to dietary treatments. Bacteroidetes dominated the ruminal bacterial community and the genus Prevotella was highly represented when steers were fed LO plus propionate precursors. However, with the CON and LO diet plus malate or fumarate, Firmicutes was the most abundant phylum and the genus Ruminococcus was predominant. In summary, supplementing the diets of ruminants with a moderate level of LO plus propionate precursors modified the ruminal fermentation pattern. The most positive responses to LO and propionate precursors supplementation were in the phyla Bacteriodetes and Firmicutes, and in the genus Ruminococcus and Prevotella. Thus, diets containing LO plus malate or fumarate have significant effects on the composition of the rumen microbial community.