Plant microbiomes are shaped by forces working at different spatial scales. Environmental factors determine a pool of potential symbionts while host physiochemical factors influence how those microbes associate with distinct plant tissues. These scales are seldom considered simultaneously, despite their potential to interact. Here, we analyze epiphytic microbes from nine Hibiscus tiliaceus trees across a steep, but short, environmental gradient within a single Hawaiian watershed. At each location, we sampled eight microhabitats: leaves, petioles, axils, stems, roots, and litter from the plant, as well as surrounding air and soil. The composition of bacterial communities is better explained by microhabitat, while location better predicted compositional variance for fungi. Fungal community compositional dissimilarity increased more rapidly along the gradient than did bacterial composition. Additionally, the rates of fungal community compositional dissimilarity along the gradient differed among plant parts, and these differences influenced the distribution patterns and range size of individual taxa. Within plants, microbes were compositionally nested such that aboveground communities contained a subset of the diversity found belowground. Our findings indicate that both environmental context and microhabitat contribute to microbial compositional variance in our study, but that these contributions are influenced by the domain of microbe and the specific microhabitat in question, suggesting a complicated and potentially interacting dynamic.