Mono-allelic germline disruptions of the transcription factor GATA2 result in a propensity for developing myelodysplastic syndrome (MDS) and acute myeloid leukemia (AML), affecting more than 85% of carriers. How a partial loss of GATA2 functionality enables leukemic transformation years later is unclear. This question has remained unsolved mainly due to the lack of informative models, as Gata2 heterozygote mice do not develop hematologic malignancies. Here we show that two different germline Gata2 mutations (TgErg/Gata2het and TgErg/Gata2L359V) accelerate AML in mice expressing the human hematopoietic stem cell regulator ERG. Analysis of Erg/Gata2het fetal liver and bone marrow-derived hematopoietic cells revealed a distinct pre-leukemic phenotype. This was characterized by enhanced transition from stem to progenitor state, increased proliferation, and a striking mitochondrial phenotype, consisting of highly expressed oxidative-phosphorylation-related gene sets, elevated oxygen consumption rates, and notably, markedly distorted mitochondrial morphology. Importantly, the same mitochondrial gene-expression signature was observed in human AML harboring GATA2 aberrations. Similar to the observations in mice, non-leukemic bone marrows from children with germline GATA2 mutation demonstrated marked mitochondrial abnormalities. Thus, we observed the tumor suppressive effects of GATA2 in two germline Gata2 genetic mouse models. As oncogenic mutations often accumulate with age, GATA2 deficiency-mediated priming of hematopoietic cells for oncogenic transformation may explain the earlier occurrence of MDS/AML in patients with GATA2 germline mutation. The mitochondrial phenotype is a potential therapeutic opportunity for the prevention of leukemic transformation in these patients.