The nonrecombining Drosophila melanogaster Y chromosome is heterochromatic and has few genes. Despite these limitations, there remains ample opportunity for natural selection to act on the genes that are vital for male fertility and on Y factors that modulate gene expression elsewhere in the genome. Y chromosomes of many organisms have low levels of nucleotide variability, but a formal survey of D. melanogaster Y chromosome variation had yet to be performed. Here we surveyed Y-linked variation in six populations of D. melanogaster spread across the globe. We find surprisingly low levels of variability in African relative to Cosmopolitan (i.e., non-African) populations. While the low levels of Cosmopolitan Y chromosome polymorphism can be explained by the demographic histories of these populations, the staggeringly low polymorphism of African Y chromosomes cannot be explained by demographic history. An explanation that is entirely consistent with the data is that the Y chromosomes of Zimbabwe and Uganda populations have experienced recent selective sweeps. Interestingly, the Zimbabwe and Uganda Y chromosomes differ: in Zimbabwe, a European Y chromosome appears to have swept through the population.