Compared with root-associated habitats, little is known about the role of microbiota inside other rice organs, especially the rhizome of perennial wild rice, and this information may be of importance for agriculture. Oryza longistaminata is perennial wild rice with various agronomically valuable traits, including large biomass on poor soils, high nitrogen use efficiency, and resistance to insect pests and disease. Here, we compared the endophytic bacterial and archaeal communities and network structures of the rhizome to other compartments of O. longistaminata using 16S rRNA gene sequencing. Diverse microbiota and significant variation in community structure were identified among different compartments of O. longistaminata. The rhizome microbial community showed low taxonomic and phylogenetic diversity as well as the lowest network complexity among four compartments. Rhizomes exhibited less phylogenetic clustering than roots and leaves, but similar phylogenetic clustering with stems. Streptococcus, Bacillus, and Methylobacteriaceae were the major genera in the rhizome. ASVs belonging to the Enhydrobacter, YS2, and Roseburia are specifically present in the rhizome. The relative abundance of Methylobacteriaceae in the rhizome and stem was significantly higher than that in leaf and root. Noteworthy type II methanotrophs were observed across all compartments, including the dominant Methylobacteriaceae, which potentially benefits the host by facilitating CH4-dependent N2 fixation under nitrogen nutrient-poor conditions. Our data offers a robust knowledge of host and microbiome interactions across various compartments and lends guidelines to the investigation of adaptation mechanisms of O. longistaminata in nutrient-poor environments for biofertilizer development in agriculture.