Rapid and divergent evolution of male genital morphology is a conspicuous and general pattern across internally fertilizing animals. Rapid genital evolution is thought to be the result of sexual selection, and the role of natural selection in genital evolution remains controversial. However, natural and sexual selection are believed to act antagonistically on male genital form. We conducted an experimental evolution study to investigate the combined effects of natural and sexual selection on the genital-arch lobes of male Drosophila simulans. Replicate populations were forced to evolve under lifetime monogamy (relaxed sexual selection) or lifetime polyandry (elevated sexual selection) and two temperature regimes, 25°C (relaxed natural selection) or 27°C (elevated natural selection) in a fully factorial design. We found that natural and sexual selection plus their interaction caused genital evolution. Natural selection caused some aspects of genital form to evolve away from their sexually selected shape, whereas natural and sexual selection operated in the same direction for other shape components. Additionally, sexual and natural selection tended to favour larger genitals. Thus we find that the underlying selection driving genital evolution is complex, does not only involve sexual selection, and that natural selection and sexual selection do not always act antagonistically.