The diversity of fungal communities on three different historical monuments in the city of Vienna (Austria) was analyzed and compared to the fungal diversity of microfungi on rock in the original quarry located in a rural area (Zogelsdorf, Austria). The fungal strains isolated were characterized by morphology and the complete rock fungal community was identified based on molecular data, that is, by sequencing parts of the small ribosomal subunit (18S) and internal transcribed spacer region 1 (ITS1). The genera Coniothyrium, Epicoccum and Phoma were found to be dominant on monument and rock surfaces. Additionally, black yeasts such as Exophiala species and microcolonial fungi like Sarcinomyces and Coniosporium which hitherto were regarded as typical rock inhabitants in semi-arid environments are frequently found on all rock surfaces in Vienna. The biodiversity of the fungi in the urban environment was much higher than on the same rock type in a rural environment, this difference can be attributed to the elevated organic pollution in the city.