Background: Animals use diverse antipredator mechanisms, including visual signalling of aversive chemical defence (aposematism). However, the initial evolution of aposematism poses the problem that the first aposematic individuals are conspicuous to predators who have not learned the significance of the warning colouration. In one scenario, aposematism evolves in group-living species and originally persisted due to kin selection or positive frequency-dependent selection in groups. Alternatively, group-living might evolve after aposematism because grouping can amplify the warning signal. However, our current understanding of the evolutionary dynamics of these traits is limited, leaving the relative merit of these scenarios unresolved.
Results: We used a phylogenetic comparative approach to estimate phenotypic evolutionary models to enable inferences regarding ancestral states and trait dynamics of grouping and aposematic colouration in a classic model system (caterpillars). We find strong support for aposematism at the root of the clade, and some (but weaker) support for ancestral solitary habits. Transition rates between aposematism and crypsis are generally higher than those between group-living and solitary-living, suggesting that colouration is more evolutionarily labile than aggregation. We also find that the transition from group-living to solitary-living states can only happen in aposematic lineage, suggesting that aposematism facilitates the evolution of solitary caterpillars, perhaps due to the additional protection offered when the benefits of grouping are lost. We also find that the high frequency of solitary, cryptic caterpillars is because this state is particularly stable, in that the transition rates moving towards this state are substantially higher than those moving away from it, favouring its accumulation in the clade over evolutionary time.
Conclusions: Our results provide new insights into the coevolution of colour and aggregation in caterpillars. We find support for an aposematic caterpillar at the root of this major clade, and for the signal augmentation hypothesis as an explanation of the evolution of aposematic, group-living caterpillars. We find that colouration is more labile than aggregation behaviour, but that the combination of solitary and cryptic habits is particularly stable. Finally, our results reveal that the transitions from group-living to solitary-living could be facilitated by aposematism, providing a new link between these well-studied traits.
Keywords: Aposematic; Coevolution; Cryptic; Group; Phenotypic evolution; Solitary.