Phylogenetic analyses increasingly take centre-stage in our understanding of the processes shaping patterns of cultural diversity and cultural evolution over time. Just as biologists explain the origins and maintenance of trait differences among organisms using phylogenetic methods, so anthropologists studying cultural macroevolutionary processes use phylogenetic methods to uncover the history of human populations and the dynamics of culturally transmitted traits. In this paper, we revisit concerns with the validity of these methods. Specifically, we use simulations to reveal how properties of the sample (size, missing data), properties of the tree (shape) and properties of the traits (rate of change, number of variants, transmission mode) might influence the inferences that can be drawn about trait distributions across a given phylogeny and the power to discern alternative histories. Our approach shows that in two example datasets specific combinations of properties of the sample, of the tree and of the trait can lead to potentially high rates of Type I and Type II errors. We offer this simulation tool to help assess the potential impact of this list of persistent perils in future cultural macroevolutionary work. This article is part of the theme issue 'Foundations of cultural evolution'.
Keywords: cultural phylogenies; horizontal transmission; macroevolution; phylogenetic methods; simulation.