Phthalate exposure has been reported to be associated with obesity (measured by body mass index [BMI]) and central obesity (measured by waist circumference [WC]). Yet, reported associations and the potential gender and age differences are inconsistent. We conducted a cross-sectional study involving 2330 participants in the fall of 2012. Urinary metabolites of ten phthalates were measured. Height, body weight, and waist circumference (WC) were measured using standardized methods. We performed logistic regression analyses to estimate the association between each urine phthalate metabolite (categorized into quartiles) and obesity and central obesity and conducted an additional, stratified analysis to explore the gender and age differences. In the overall study population, higher urinary levels of MMP, MEHHP, and MECPP were associated with increased ratios of central obesity. When stratifying by gender and central obesity, higher urinary levels of MMP, MEHHP, and MEOHP were associated with increased odds of central obesity in females, whereas MBzP was significantly associated inversely with central obesity in females. In males, it showed no significant P value for trend (P trend). When stratifying by age in females, higher urinary levels of MEHP, MEOHP, MEHHP, and MECPP were associated with increased odds of central obesity in women aged ≤45 years. In females aged >45 years, it showed no significant P trend. In conclusion, we found that association between phthalates and central obesity was stronger than between phthalates and obesity; association between phthalates and central obesity was stronger in females than in males and was stronger in younger females (aged ≤45 years) than in older females (aged >45 years).