Immune checkpoint blockade (ICB) has improved outcomes for patients with advanced cancer, but the determinants of response remain poorly understood. Here we report differential effects of mutations in the homologous recombination genes BRCA1 and BRCA2 on response to ICB in mouse and human tumors, and further show that truncating mutations in BRCA2 are associated with superior response compared to those in BRCA1. Mutations in BRCA1 and BRCA2 result in distinct mutational landscapes and differentially modulate the tumor-immune microenvironment, with gene expression programs related to both adaptive and innate immunity enriched in BRCA2-deficient tumors. Single-cell RNA sequencing further revealed distinct T cell, natural killer, macrophage, and dendritic cell populations enriched in BRCA2-deficient tumors. Taken together, our findings reveal the divergent effects of BRCA1 and BRCA2-deficiency on ICB outcome, and have significant implications for elucidating the genetic and microenvironmental determinants of response to immunotherapy.