H3K9me3-dependent heterochromatin is a major barrier of cell fate changes that must be reprogrammed after fertilization. However, the molecular details of these events are lacking in early embryos. Here, we map the genome-wide distribution of H3K9me3 modifications in mouse early embryos. We find that H3K9me3 exhibits distinct dynamic features in promoters and long terminal repeats (LTRs). Both parental genomes undergo large-scale H3K9me3 reestablishment after fertilization, and the imbalance in parental H3K9me3 signals lasts until blastocyst. The rebuilding of H3K9me3 on LTRs is involved in silencing their active transcription triggered by DNA demethylation. We identify that Chaf1a is essential for the establishment of H3K9me3 on LTRs and subsequent transcriptional repression. Finally, we find that lineage-specific H3K9me3 is established in post-implantation embryos. In summary, our data demonstrate that H3K9me3-dependent heterochromatin undergoes dramatic reprogramming during early embryonic development and provide valuable resources for further exploration of the epigenetic mechanism in early embryos.