Plant microbiome and its manipulation herald a new era for plant biotechnology with the potential to benefit sustainable crop production. However, studies evaluating the diversity, structure and impact of the microbiota in economic important crops are still rare. Here we describe a comprehensive inventory of the structure and assemblage of the bacterial and fungal communities associated with sugarcane. Our analysis identified 23,811 bacterial OTUs and an unexpected 11,727 fungal OTUs inhabiting the endophytic and exophytic compartments of roots, shoots, and leaves. These communities originate primarily from native soil around plants and colonize plant organs in distinct patterns. The sample type is the primary driver of fungal community assemblage, and the organ compartment plays a major role in bacterial community assemblage. We identified core bacterial and fungal communities composed of less than 20% of the total microbial richness but accounting for over 90% of the total microbial relative abundance. The roots showed 89 core bacterial families, 19 of which accounted for 44% of the total relative abundance. Stalks are dominated by groups of yeasts that represent over 12% of total relative abundance. The core microbiome described here comprise groups whose biological role underlies important traits in plant growth and fermentative processes.