Often considered a defining eukaryotic feature, the Golgi body is one of the most recognizable and functionally integrated cellular organelles. It is therefore surprising that some unicellular eukaryotes do not, at first glance, appear to possess Golgi stacks. Here we review the molecular evolutionary, genomic and cell biological evidence for Golgi bodies in these organisms, with the organelle likely present in some form in all cases. This, along with the overwhelming prevalence of stacked cisternae in most eukaryotes, implies that the ancestral eukaryote possessed a stacked Golgi body, with at least eight independent instances of Golgi unstacking in our cellular history.