Applying somatic cell reprogramming strategies in cancer cell biology is a powerful approach to analyze mechanisms of malignancy and develop new therapeutics. Here, we test whether leukemia cells can be reprogrammed in vivo using the canonical reprogramming transcription factors-Oct4, Sox2, Klf4, and c-Myc (termed as OSKM). Unexpectedly, we discover that OSKM can eradicate leukemia cells and dramatically improve survival of leukemia-bearing mice. By contrast, OSKM minimally impact normal hematopoietic cells. Using ATAC-seq, we find OSKM induce chromatin accessibility near genes encoding apoptotic regulators in leukemia cells. Moreover, this selective effect also involves downregulation of H3K9me3 as an early event. Dissection of the functional effects of OSKM shows that Klf4 and Sox2 play dominant roles compared to c-Myc and Oct4 in elimination of leukemia cells. These results reveal an intriguing paradigm by which OSKM-initiated reprogramming induction can be leveraged and diverged to develop novel anti-cancer strategies.