The complex microbiome of the rumen functions as an effective system for the conversion of plant cell wall biomass to microbial proteins, short chain fatty acids and gases. In this study, metagenomic approaches were used to study the microbial populations and metabolic potential of the microbial community. DNA was extracted from Surti Buffalo rumen samples (four treatments diet) and sequenced separately using a 454 GS FLX Titanium system. We used comparative metagenomics to examine metabolic potential and phylogenetic composition from pyrosequence data generated in four samples, considering phylogenetic composition and metabolic potentials in the rumen may remarkably be different with respect to nutrient utilization. Assignment of metagenomic sequences to SEED categories of the Metagenome Rapid Annotation using Subsystem Technology (MG-RAST) server revealed a genetic profile characteristic of fermentation of carbohydrates in a high roughage diet. The distribution of phylotypes and environmental gene tags (EGTs) detected within each rumen sample were dominated by Bacteroidetes/Chlorobi, Firmicutes and Proteobacteria in all the samples. The results of this study could help to determine the role of rumen microbes and their enzymes in plant polysaccharide breakdown is fundamental to understanding digestion and maximising productivity in ruminant animals.