When pollinators use flower color to locate food sources, a distinct color can serve as a reproductive barrier against co-flowering species. This anti-interference function of flower color may result in a community assembly of plant species displaying mutually different flower colors. However, such color dispersion is not ubiquitous, suggesting a variable selection across communities and existence of some opposing factors. We conducted a 30-week study in a plant community and measured the floral reflectances of 244 species. The reflectances were evaluated in insect color spaces (bees, swallowtails, and flies), and the dispersion was compared with random expectations. We found that co-existing colors were overdispersed for each analyzed pollinator type, and this overdispersion was statistically significant for bees. Furthermore, we showed that exclusion of 32 aliens from the analysis significantly increased the color dispersion of native flowers in every color space. This result indicated that aliens disturbed a native plant-pollinator network via similarly colored flowers. Our results demonstrate the masking effects of aliens in the detection of color dispersion of native flowers and that variations in pollinator vision yield different outcomes. Our results also support the hypothesis that co-flowering species are one of the drivers of color diversification and affect the community assembly.