Microbial communities in arctic-alpine soils show biogeographic patterns related to elevation, but the effect of fine-scale heterogeneity and possibly related temperature and soil moisture regimes remains unclear. We collected soil samples from different micro-topographic positions and elevational levels in two mountain regions of the Scandes, Central Norway. Microbial community composition was characterized by 16S rRNA gene amplicon sequencing and was dependent on micro-topography and elevation. Underlying environmental drivers were identified by integration of microbial community data with a comprehensive set of site-specific long-term recorded temperature and soil moisture data. Partial least square regression analysis allowed the description of ecological response patterns and the identification of the important environmental drivers for each taxonomic group. This demonstrated for the first time that taxa responding to elevation were indeed most strongly defined by temperature, rather than by other environmental factors. Micro-topography affected taxa were primarily controlled by temperature and soil moisture. In general, 5-year datasets had higher explanatory power than 1-year datasets, indicating that the microbial community composition is dependent on long-term developments of near-ground temperature and soil moisture regimes and possesses a certain resilience, which is in agreement with an often observed delayed response in global warming studies in arctic-alpine regions.