Sperm contributes genetic and epigenetic information to the embryo to efficiently support development. However, the mechanism underlying such developmental competence remains elusive. Here, we investigated whether all sperm cells have a common epigenetic configuration that primes transcriptional program for embryonic development. Using calibrated ChIP-seq, we show that remodelling of histones during spermiogenesis results in the retention of methylated histone H3 at the same genomic location in most sperm cell. This homogeneously methylated fraction of histone H3 in the sperm genome is maintained during early embryonic replication. Such methylated histone fraction resisting post-fertilisation reprogramming marks developmental genes whose expression is perturbed upon experimental reduction of histone methylation. A similar homogeneously methylated histone H3 fraction is detected in human sperm. Altogether, we uncover a conserved mechanism of paternal epigenetic information transmission to the embryo through the homogeneous retention of methylated histone in a sperm cells population.