The purpose of this review is to examine what is known about cognitive and brain aging in elders with chronic epilepsy. We contend that much remains to be learned about the ultimate course of cognition and brain structure in persons with chronic epilepsy and concern appears warranted. Individuals with chronic epilepsy are exposed to many risk factors demonstrated to be associated with abnormal cognitive and brain aging in the general population, with many of these risk factors present in persons with chronic epilepsy as early as midlife. We suggest that a research agenda be developed to systematically identify and treat known modifiable risk factors in order to protect and promote cognitive and brain health in aging and elder persons with chronic epilepsy.