The evolution of sexual dimorphism and expansion of sex chromosomes are both driven through sexual conflict, arising from differing fitness optima between males and females. Here, we pair work in poplar (Populus) describing one of the smallest sex-determining regions known thus far in complex eukaryotes (~100 kbp) with comprehensive tests for sexual dimorphism using >1300 individuals from two Populus species and assessing 96 non-reproductive functional traits. Against expectation, we found sexual homomorphism (no non-reproductive trait differences between the sexes), suggesting that gender is functionally neutral with respect to non-reproductive features that affect plant survival and fitness. Combined with a small sex-determining region, we infer that sexual conflict may be effectively stymied or non-existent within these taxa. Both sexual homomorphism and the small sex-determining region occur against a background of strong environmental selection and local adaptation in Populus. This presents a powerful hypothesis for the evolution of dioecious species. Here, we suggest that environmental selection may be sufficient to suppress and stymy sexual conflict if it acts orthogonal to sexual selection, thereby placing limitations on the evolution of sexual dimorphism and genomic expansion of sex chromosomes.