Poly(lactide-co-glycolide) (PLGA) and calcium sulfate composites are promising biodegradable biomaterials but are still challenging to use in people with high levels of blood glucose or diabetes. To date, the influence of glucose on their degradation has not yet been elucidated and thus calls for more research attention. Herein, a novel calcium sulfate whisker with L-arginine was used to effectively tune its crystal morphology and was employed as a reinforced phase to construct the PLGA-based composite scaffolds (ArgCSH/PLGA) with a sleeve porous structure. ArgCSH/PLGA showed excellent elastic modulus and strength in the compression and bending models. Moreover, an in vitro immersion test showed that ArgCSH/PLGA possessed degradation and redeposition behaviors sensitive to glucose concentration, and the adsorbed Arg played a crucial role in the degradation process. The subsequent cell functional evaluation showed that ArgCSH could effectively protect cells from damage caused by AGEs and promote osteogenic differentiation. The corresponding degradation products of ArgCSH/PLGA displayed the ability to regulate osteoblast bone differentiation and accelerate matrix mineralization. These findings provide new insights into the interaction between biomaterials and the physiological environment, which may be useful in expanding the targeted choice of efficient bone graft biodegradable materials for diabetic osteoporosis.