Androgen deprivation therapy (ADT) induces severe hypogonadism and is associated with several adverse effects that negatively affect health and quality of life in patients with prostate cancer. ADT changes body composition characterized by an increase in fat mass and a reduction in muscle mass and strength. Insulin sensitivity is also diminished and population-based studies indicate an increased risk of diabetes mellitus and cardiovascular disease in men receiving ADT. Particularly the first 6 months of treatment seem to hold an additional risk of new cardiovascular events for patients with already existing cardiovascular disease. In this initial phase of ADT, metabolic changes are also most prominent. In addition, ADT increases the rate of bone loss and fracture risk. Currently available evidence supports the use of exercise interventions to improve physical function and mitigate ADT-induced fatigue. Some studies also indicate that exercise might moderate ADT-related changes in body composition. However, beneficial effects of exercise interventions on other ADT-related conditions have not been conclusively proven. Trials investigating the effects of ADT on fracture risk and development of diabetes mellitus and cardiovascular disease are still warranted. Furthermore, studies investigating safety and effects of physical activity in men with bone metastases are lacking.