The Rb-E2F axis is an important pathway involved in cell-cycle control that is deregulated in a number of cancers. E2f transcription factors have distinct roles in the control of cell proliferation, cell survival and differentiation in a variety of tissues. We have previously shown that E2fs are important downstream targets of a CSF-1 signaling cascade involved in myeloid development. In cancer, tumor-associated macrophages (TAMs) are recruited to the tumor stroma in response to cytokines secreted by tumor cells, and are believed to facilitate tumor cell invasion and metastasis. Using the MMTV-Polyoma Middle T antigen (PyMT) mouse model of human ductal carcinoma, we show that the specific ablation of E2f3 in TAMs, but not in tumor epithelial cells, attenuates lung metastasis without affecting primary tumor growth. Histological analysis and gene expression profiling suggest that E2f3 does not impact the proliferation or survival of TAMs, but rather controls a novel gene expression signature associated with cytoskeleton rearrangements, cell migration and adhesion. This E2f3 TAM gene expression signature was sufficient to predict cancer recurrence and overall survival of estrogen receptor (ER)-positive breast cancer patients. Interestingly, we find that E2f3b but not E2f3a levels are elevated in TAMs from PyMT mammary glands relative to controls, suggesting a differential role for these isoforms in metastasis. In summary, these findings identify E2f3 as a key transcription factor in TAMs, which influences the tumor microenvironment and tumor cell metastasis.