Vitamin D insufficiency is a global health problem. The data on vitamin D status in Malaysian men is insufficient. This study aimed to investigate vitamin D status among Chinese and Malay men in Malaysia and its associating factors. A cross-sectional study was conducted on 383 men aged 20 years and above, residing in Klang Valley, Malaysia. Their age, ethnicity, body anthropometry and calcaneal speed of sound (SOS) were recorded. Their fasting blood was collected for serum 25-hydroxyvitamin D (25(OH)D), intact parathyroid (PTH), total calcium and inorganic phosphate assays. Vitamin D deficiency was defined as a serum 25(OH)D level <30 nmol/L and insufficiency as a serum 25(OH)D level between 30 and 50 nmol/L. The overall prevalence of vitamin D deficiency was 0.5%, and insufficiency was 22.7%. Vitamin D deficiency and insufficiency were more prevalent in the Malays compared to the Chinese. Being Chinese, older in age, having lower body mass index (BMI) and a high physical activity status were associated significantly with a higher serum 25(OH)D level (p < 0.05). The serum PTH level was inversely associated with the serum 25(OH)D level (p < 0.05). As a conclusion, a significant proportion of Malaysian men have vitamin D insufficiency, although deficiency is uncommon. Steps should be taken to correct the vitamin D status of these men.