Microbial communities of the Chinese marginal seas have rarely been reported. Here, bacterial and archaeal community structures and abundance in the surface sediment of four sea areas including the Bohai Sea (BS), North Yellow Sea (NYS), South Yellow Sea (SYS), and the north East China Sea (NECS) were surveyed by 16S ribosomal RNA (rRNA) gene pyrosequencing and quantitative PCR. The results showed that microbial communities of the four geographic areas were distinct from each other at the operational taxonomic unit (OTU) level, whereas the microbial communities of the BS, NYS, and SYS were more similar to each other than to the NECS at higher taxonomic levels. Across all samples, Bacteria were numerically dominant relative to Archaea, and among them, Gammaproteobacteria and Euryarchaeota were predominant in the BS, NYS, and SYS, while Deltaproteobacteria and Thaumarchaeota were prevalent in the NECS. The most abundant bacterial genera were putative sulfur oxidizer and sulfate reducer, suggesting that sulfur cycle processes might prevail in these areas, and the high abundance of dsrB (10(7)-10(8) copies g(-1)) in all sites verified the dominance of sulfate reducer in the north Chinese marginal seas. The differences in sediment sources among the sampling areas were potential explanations for the observed microbial community variations. Furthermore, temperature and dissolved oxygen of bottom water were significant environmental factors in determining both bacterial and archaeal communities, whereas chlorophyll a in sediment was significant only in structuring archaeal community. This study presented an outline of benthic microbial communities and provided insights into understanding the biogeochemical cycles in sediments of the north Chinese marginal seas.