The association between endocrine disrupting chemicals (EDCs) and human sperm quality is controversial due to the inconsistent literature findings, therefore, a systematic review with meta-analysis was performed. Through the literature search and selection based on inclusion criteria, a total of 9 studies (7 cross-sectional, 1 case-control, and 1 pilot study) were analyzed for classic EDCs (5 studies for phthalate esters and 4 studies for organochlorines). Funnel plots revealed a symmetrical distribution with no evidence of publication bias (Begg's test: intercept = 0.40; p = 0.692). The summary odds ratios (OR) of human sperm quality associated with the classic EDCs was 1.67 (95% CI: 1.31-2.02). After stratification by specific chemical class, consistent increases in the risk of abnormal sperm quality were found in phthalate ester group (OR = 1.52; 95% CI: 1.09-1.95) and organochlorine group (OR = 1.98; 95% CI: 1.34-2.62). Additionally, identification of official data, and a comprehensive review of the mechanisms were performed, and better elucidated the increased risk of these classic EDCs on abnormal sperm quality. The present systematic review and meta-analysis helps to identify the impact of classic EDCs on human sperm quality. However, it still highlights the need for additional epidemiological studies in a larger variety of geographic locations.