Biological aging is the correlated decline of multi-organ system integrity central to the etiology of many age-related diseases. A novel epigenetic measure of biological aging, DunedinPACE, is associated with cognitive dysfunction, incident dementia, and mortality. Here, we tested for associations between DunedinPACE and structural MRI phenotypes in three datasets spanning midlife to advanced age: the Dunedin Study (age=45 years), the Framingham Heart Study Offspring Cohort (mean age=63 years), and the Alzheimer's Disease Neuroimaging Initiative (mean age=75 years). We also tested four additional epigenetic measures of aging: the Horvath clock, the Hannum clock, PhenoAge, and GrimAge. Across all datasets (total N observations=3,380; total N individuals=2,322), faster DunedinPACE was associated with lower total brain volume, lower hippocampal volume, and thinner cortex. In two datasets, faster DunedinPACE was associated with greater burden of white matter hyperintensities. Across all measures, DunedinPACE and GrimAge had the strongest and most consistent associations with brain phenotypes. Our findings suggest that single timepoint measures of multi-organ decline such as DunedinPACE could be useful for gauging nervous system health.