Because activated estrogen (ER) and androgen (AR) receptors stimulate cell proliferation in breast and prostate cancer, inhibiting their actions represents a major therapeutic goal. Most efforts to modulate ER and AR activity have focused on inhibiting the synthesis of estrogens or androgens or on the identification of small molecules that act by competing with agonist hormones for binding in the ligand-binding pocket of the receptor. An alternative approach is to implement screens for small molecule inhibitors that target other sites in the pathway of steroid receptor action. Many of these second-site inhibitors directly target ER or AR; others have still unknown sites of action. Small molecule inhibitors that target second sites represent new leads with clinical potential; they serve as novel modulators of receptor action; and they can reveal new and as yet unidentified interactions and pathways that modulate ER and AR action.