Evolutionary analysis of microbes at the community level represents a new research avenue linking ecological patterns to evolutionary processes, but remains insufficiently studied. Here we report a relative evolutionary rates (rERs) analysis of microbial communities from six diverse natural environments based on 40 metagenomic samples. We show that the rERs of microbial communities are mainly shaped by environmental conditions, and the microbes inhabiting extreme habitats (acid mine drainage, saline lake and hot spring) evolve faster than those populating benign environments (surface ocean, fresh water and soil). These findings were supported by the observation of more relaxed purifying selection and potentially frequent horizontal gene transfers in communities from extreme habitats. The mechanism of high rERs was proposed as high mutation rates imposed by stressful conditions during the evolutionary processes. This study brings us one stage closer to an understanding of the evolutionary mechanisms underlying the adaptation of microbes to extreme environments.