Despite the development of diversity indices in community ecology that incorporate both richness and evenness, pollination biologists commonly use only pollinator richness to estimate generalization. Similarly, while pollination biologists have stressed the utility of pollinator importance, incorporating both pollinator abundance and effectiveness, importance values have not been included in estimates of generalization in pollination systems. In this study, we estimated pollinator generalization for 17 plant species using Simpson's diversity index, which includes richness and evenness. We compared these estimates with estimates based on only pollinator richness, and compared diversity estimates calculated using importance data with those using only visitation data. We found that pollinator richness explains only 57-65% of the variation in diversity, and that, for most plant species, pollinator importance was determined primarily by differences in visitation rather than by differences in effectiveness. While simple richness may suffice for broad comparisons of pollinator generalization, measures that incorporate evenness will provide a much more accurate understanding of generalization. Although incorporating labor-intensive measurements of pollinator effectiveness are less necessary for broad surveys, effectiveness estimates will be important for detailed studies of some plant species. Unfortunately, at this point it is impossible to predict a priori which species these are.