Rhizoma Coptidis (Huang Lian in Chinese pinyin) is among the most widely used traditional Chinese herbal medicines and has a profound history of more than 2000 years of being used as a therapeutic herb. The antidiabetic effects of Rhizoma Coptidis have been extensively investigated in animal experiments and clinical trials and its efficacy as a promising antihyperglycemic agent has been widely discussed. In the meantime, findings from modern pharmacological studies have contributed the majority of its bioactivities to berberine, the isoquinoline alkaloids component of the herb, and a number of experiments testing the antidiabetic effects of berberine have been initiated. Therefore, we conducted a review of the current evidence profile of the antihyperglycemic effects of Rhizoma Coptidis as well as its main component berberine and the possible mechanism of actions, in order to summarize research evidence in this area and identify future research directions.