Since the middle of the last century, Paramecium has appeared as an intriguing genetic model, displaying a variety of heritable characters which do not follow the Mendel laws but are cytoplasmically inherited. The analysis of the hereditary mechanisms at play in this eukaryotic unicellular organism has provided new insight into epigenetics mechanisms. Interestingly, the revealing phenomena concern two pecularities of Paramecium, its highly elaborate surface structure (with thousands of ciliary basal bodies as cytoskeleton organizers), and its nuclear dualism (coexistence of a diploid "germline" micronucleus and a highly polyploid somatic macronucleus devoted to transcription, which contains a rearranged version of the germline genome). Analysis of variant cortical organization has led to the concept of structural inheritance, implying that assembly of new organelles and supramolecular protein complexes is guided by pre-existing organization. Analysis of other cytoplasmically inherited characters revealed that the developing macronucleus is epigenetically programmed by the maternal macronucleus through RNA-mediated, homology-dependent effects, suggesting the transcriptome should be recognized as a third actor in cellular inheritance, along with the "structurome" and the genome.