A recent dramatic increase in elderly patients with diabetes mellitus has made the proper management of the disease in this population more important. Here, we discuss the present status of diabetes management in the elderly in Japan. As a characteristic feature of elderly persons, body weight reduction is difficult, because of the profound adaptive reduction in resting energy expenditure under calorie restriction in the elderly. However, hyperglycemia increases the risk for diabetic complications, except proliferative retinopathy, similarly in elderly and non-elderly. Of note, there is marked clinical heterogeneity in this generation in the following aspects: duration, complication status (past aspect), insulin secretion, insulin sensitivity, familial support and physical exercise/activity (present aspect), as well as the expected lifespan (future aspect). This heterogeneity among the elderly should render diabetes treatment diverse, and in fact, one of the largest surveys in Japan demonstrated significant diversity in diabetes management in the elderly. In Japan, thus, the present management of diabetes in the elderly is considerably diverse, reflecting the clinical heterogeneity among elderly patients with diabetes. Further clinical evidence is awaited for the establishment of proper and safe management of diabetes in the elderly.