As one of the main active component of protopanaxdiol type ginsenosides, ginsenoside Rb(3) is rarely reported in the treatment of diabetes. The anti-diabetic activity of ginsenoside Rb(3) was investigated in a model of alloxan-induced diabetic mice in the present study. The physiological parameter such as fasting blood glucose level, oral glucose tolerance, body weight, food intake and water intake were measured. Glucose consumption in C2C12 myotubes was also determined in order to investigate the molecular mechanism of ginsenoside Rb(3) in anti-diabetes. The alloxan-induced diabetic mice were treated with ginsenoside Rb(3) for 2 weeks at doses of 5 mg/kg, 15 mg/kg and 25 mg/kg. After 2 weeks treatment of ginsenoside Rb(3), the fasting blood glucose levels of DG 15 and DG 25 were respectively reduced by 36.70% and 37.50% compared to control group. At a dose of 25 mg/kg, oral glucose tolerance was significantly improved compared to control group (P < 0.05). The AUC decreased by 34.47% (from 2442 ± 291 mmol·min/L to 1600 ± 109 mmol·min/L). Both food intake and water intake were remarkably lowered. The injury of pancreas tissues was repaired, which was observed by using HE staining and optic microscope. In vitro, at concentrations of 100 and 200 µM, ginsenoside Rb(3) increased glucose consumption in C2C12 myotubes by 76.83% and 97.20%, respectively, as compared to the control group. However, the body weight of diabetic mice was not significantly altered. In conclusion, our results showed that ginsenoside Rb(3) reduced fasting blood glucose level, food intake, water intake, improved oral glucose tolerance, and repaired injured pancreas tissues of alloxan-induced diabetic mice. Therefore, it was suggested that ginsenoside possesses the potential of the clinical use in preventing and treating diabetes.