Historical, niche-based, and stochastic processes have been proposed as the mechanisms that drive community assembly. In plant-herbivore systems, these processes can correspond to phylogeny, leaf traits, and the distribution of host plants, respectively. Although patterns of herbivore assemblages among plant species have been repeatedly examined, the effects of these factors among co-occurring congeneric host plant species have rarely been studied. Our aim was to reveal the process of community assembly for herbivores by investigating the effects of phylogeny, leaf traits, and the altitudinal distribution of closely related host plants of the genus Acer. We sampled leaf functional traits for 30 Acer species in Japan. Using a newly constructed phylogeny, we determined that three of the six measured leaf traits (leaf thickness, C/N ratio, and condensed tannin content) showed a phylogenetic signal. In a field study, we sampled herbivore communities on 14 Acer species within an elevation gradient and examined relationships between herbivore assemblages and host plants. We found that herbivore assemblages were significantly correlated with phylogeny, leaf traits, phylogenetic signals, and the altitudinal distribution of host plants. Our results indicate that the interaction between historical and current ecological processes shapes herbivore community assemblages.