Metabolic diseases, especially diabetes mellitus, have become global health issues. The etiology of diabetes mellitus can be attributed to genetic and/or environmental factors. Current evidence suggests the association of gut microbiota with metabolic diseases. However, the effects of glucose-lowering agents on gut microbiota are poorly understood. Several studies revealed that these agents affect the composition and diversity of gut microbiota and consequently improve glucose metabolism and energy balance. Possible underlying mechanisms include affecting gene expression, lowering levels of inflammatory cytokines, and regulating the production of short-chain fatty acids. In addition, gut microbiota may alleviate adverse effects caused by glucose-lowering agents, and this can be especially beneficial in diabetic patients who experience severe gastrointestinal side effects and have to discontinue these agents. In conclusion, gut microbiota may provide a novel viewpoint for the treatment of patients with diabetes mellitus.