Prostate cancer (PCa) is the most commonly diagnosed cancer in men in the Western world. The transition of androgen-dependent PCa to castration-resistant (CRPC) is a major clinical manifestation during disease progression and presents a therapeutic challenge. Our studies have shown that genetic ablation of inhibitor of differentiation 4 (Id4), a dominant-negative helix loop helix protein, in mice results in prostatic intraepithelial neoplasia lesions and decreased Nkx3.1 expression without the loss of androgen receptor (Ar) expression. ID4 is also epigenetically silenced in the majority of PCa. However, the clinical relevance and molecular pathways altered by ID4 inactivation in PCa are not known. This study investigates the effect of loss of ID4 in PCa cell lines on tumorigenicity and addresses the underlying mechanism. Stable silencing of ID4 in LNCaP cells (L-ID4) resulted in increased proliferation, migration, invasion, and anchorage-independent growth. An increase in the rate of tumor growth, weight, and volume was observed in L-ID4 xenografts compared with that in the LNCaP cells transfected with nonspecific short hairpin RNA (L+ns) in noncastrated mice. Interestingly, tumors were also observed in castrated mice, suggesting that loss of ID4 promotes CRPC. RNA sequence analysis revealed a gene signature mimicking that of constitutively active AR in L-ID4, which was consistent with gain of de novo steroidogenesis. Prostate-specific antigen expression as a result of persistent AR activation was observed in L-ID4 cells but not in L+ns cells. The results demonstrate that ID4 acts as a tumor suppressor in PCa, and its loss, frequently observed in PCa, promotes CRPC through constitutive AR activation.