Steroid hormones play an essential role in a wide range of physiological and pathological processes, such as growth, metabolism, aging, and hormone-sensitive cancers. Estrogens are no exception and influence growth, differentiation, and functioning of many target tissues, such as the mammary gland, uterus, hypothalamus, pituitary, bone, and liver. Although very similar in structure, each steroid class (i.e., estrogens, androgens, progestins, mineral corticoids, or glucocorticoids) is responsible for distinct physiological processes. To permit specific biological responses for a given steroid class, specific proteins are responsible for steroid bioactivation, action, and inactivation, yet they have low or no affinity to other classes. Estrogens make no exception and possess their own set of related proteins. To understand the molecular basis underlying estrogen recognition from other steroids, structural features of estrogen-specific proteins were analyzed along with their ability to discriminate between steroid hormones belonging to different classes. Hence, the study of all estrogen-specific proteins for which an atomic structure has been determined demonstrated that a common steroid-binding pocket architecture is shared by these proteins. This architecture is composed of the following elements: i) a glutamate residue acting as a proton acceptor coupled with a proton donor that interact with the steroid O3; ii) a proton donor (His or Ser) that interacts with O17; iii) a highly conserved sandwich-like structure providing steric hindrance and preventing C19 steroid from binding; and iv) several amino acid residues interacting with the C18. As these different estrogen-specific proteins are not related in overall sequence, the inference is that the steroid binding site in these proteins has originated by convergent evolution.