Polygenic sex determination, although suspected in several species, is thought to be evolutionarily unstable and has been proven in very few cases. In the European sea bass, temperature is known to influence the sex ratio. We set up a factorial mating, producing 5.893 individuals from 253 full-sib families, all reared in a single batch to avoid any between-families environmental effects. The proportion of females in the offspring was 18.3%, with a large variation between families. Interpreting sex as a threshold trait, the heritability estimate was 0.62 +/- 0.12. The observed distribution of family sex ratios was in accordance with a polygenic model or with a four-sex-factors system with environmental variance and could not be explained by any genetic model without environmental variance. We showed that there was a positive genetic correlation between weight and sex (r(A) = 0.50 +/- 0.09), apart from the phenotypic sex dimorphism in favor of females. This supports the hypothesis that a minimum size is required for sea bass juveniles to differentiate as females. An evolution of sex ratio by frequency-dependent selection is expected during the domestication process of Dicentrarchus labrax populations, raising concern about the release of such fish in the wild.