Sponges are abundant, diverse and functionally important organisms of coral reef ecosystems. Sponge-associated microorganisms have been receiving greater attention because of their significant contribution to sponge biomass, biogeochemical cycles and biotechnological potentials. However, our understanding of the sponge microbiome is limited to a few species of sponges from restricted geographical locations. Here, we report for the first time the bacterial diversity of two cohabiting sponges, viz. Cinachyra cavernosa and Haliclona pigmentifera, as well as that in the ambient water from the coral reef ecosystems of the Gulf of Mannar, located along the southeast coast of India. Two hundred and fifty two clones in the 16S rRNA gene library of these sponges were grouped into eight distinct phyla, of which four belonged to the core group that are associated only with sponges. Phylogenetic analysis of the core bacteria showed close affinity to other sponge-associated bacteria from different geographical locations. γ-Proteobacteria, Chloroflexi, Planctomycetes and Deferribacter were the core groups in C. cavernosa while β and δ-Proteobacteria performed this role in H. pigmentifera. We observed greater OTU diversity for C. cavernosa (Hǀ 2.07) compared to H. pigmentifera (Hǀ 1.97). UniFrac analysis confirmed the difference in bacterial diversity of the two sponge species and also between the sponges and the reef water (p<0.001). The results of our study restate the existence of a host driven force in shaping the sponge microbiome.