Epigenetic regulation is important for stable maintenance of cell identity. For continued function of organs and tissues, illegitimate changes in cell identity must be avoided. Failure to do so can trigger tumour development and disease. How epigenetic patterns are established during cell differentiation has been explored by studying model systems such as X inactivation. Mammals balance the X-linked gene dosage between the sexes by silencing of one of the two X chromosomes in females. This is initiated by expression of the non-coding X-inactive specific transcript (Xist) RNA and depends on specific cellular contexts, in which essential silencing factors are expressed. Normally X inactivation is initiated in early embryogenesis, but recent reports identified instances where Xist is expressed and can initiate gene repression. Here we describe the features that characterize the cellular permissivity to initiation of X inactivation and note that these can also occur in cancer cells and in specific haematopoietic progenitors. We propose that embryonic pathways for epigenetic regulation are re-established in adult progenitor cells and tumour cells. Understanding their reactivation will deepen our understanding of tumourigenesis and may be exploited for cancer therapy.