The Loess Plateau region of northwestern China has unique geological and dry/semi-dry climate characteristics. However, knowledge about ectomycorrhizal fungal (EMF) communities in the Loess Plateau is limited. In this study, we investigated EMF communities in Populus simonii and Pinus tabuliformis patches within the forest-steppe zone, in pine forests within the forest zone, and the transitional zone between them. We revealed high species richness (115 operational taxonomic units [OTUs]) of indigenous EMF resources at the Loess Plateau, of which Tomentella (35 OTUs), Inocybe (16), Sebacina (16), and Geopora (7) were the most OTU-rich lineages. EMF richness within the forest-steppe zone and the transitional zone was limited, while the natural pine forest maintained diverse EMF communities in the forest zone. The changes of EMF community richness and composition along arid eco-zones were highlighted for the complex factors including precipitation, soil factors, host, DBH, and altitude. Indicator analysis revealed that some EMF showed clear host preference and some taxa, i.e., genera Geopora and Inocybe, were dominant in drought and alkaline-saline conditions attributed to their environmental preference. This study revealed that EMF communities were quite limited in the forest-steppe zone, while the forest region contained diverse EMF communities in the Loess Plateau.