Glycemic variability (GV) has been an emerging target for preventing complications related to type 2 diabetes. For reducing GV, DPP-IV inhibitors have shown effectiveness compared to other oral anti-hyperglycemic drugs (OADs), but systematic evaluation has yet to be existed. A systematic review and meta-analysis of randomized controlled trials (RCTs) were performed to evaluate the effect of DPP-IV inhibitors compared with other OADs, on GV as measured by mean amplitude of glycemic excursions (MAGE). Searches were conducted using Pubmed, EMBASE, and the Cochrane Library, from which eligible studies were retrieved; seven RCTs were included in the analysis. DPP-IV inhibitors were found to significantly reduce MAGE compared to other OADs (mean difference = -14.61; 95% CI = -19.00 to -10.21; p < 0.0001) without significant heterogeneity among sulfonylureas (mean difference = -14.93; 95% CI = -21.60 to -8.26; p < 0.0001). Initial combination therapy with DPP-IV inhibitors more effectively reduced MAGE than stepwise add-on therapies (p = 0.006), although no differences in MAGE were found based on HbA1c values. These findings indicate that DPP-IV inhibitors are promising alternatives for reducing GV in type 2 diabetes patients. However, further studies utilizing larger numbers of patients and longer-term follow-ups are needed.