Microbial community structure of crude petroleum oil (CP)- and refined petroleum oil (RP)-contaminated soil was investigated. The taxonomical and functional diversity of such soils can be a great source of information about microbial community and genes involved in petroleum hydrocarbon (PHC) degradation. In this study, microbial diversity of soils contaminated by RP from urban biome of Pune, India, and CP from agricultural biome of Gujarat, India, were assessed by 16S rRNA amplicon sequencing on Illumina MiSeq platform. Association between the soil microbial community and the physicochemical parameters were investigated for their potential role. In RP- and CP-contaminated soils, the microbiome analysis showed Proteobacteria as most dominant phylum followed by Actinobacteria. Interestingly, Firmicutes were most prevailing in a CP-contaminated sample while they were least prevailing in RP-contaminated soils. Soil moisture content, total organic carbon and organic nitrogen content influenced the taxa diversity in these soils. Species richness was more in RP as compared to CP soils. Further prediction of metagenome using PICRUSt revealed that the RP and CP soils contain microbial communities with excellent metabolic potential for PHC degradation. Microbial community contributing to genes essential for soil health improvement and plant growth promotion was also gauged. Our analysis showed promising results for future bioaugmentation assisted phytoremediation (BAP) strategies for treating such soils.