Facial appearance expresses numerous cues about physical qualities as well as psychosocial and personality traits. Attractive faces are recognized clearly when seen and are often viewed advantageously in professional, social and romantic relationships. On the other hand, self-perceived attractiveness is not well understood and has been mainly attributed to psychological and cognitive factors. Here we use 3-dimensional facial surface data of a large young adult population (n = 601) to thoroughly assess the effect of facial shape on self-perceived facial attractiveness. Our results show that facial shape had a measurable effect on self-perception of facial attractiveness in both sexes. In females, self-perceived facial attractiveness was linked to decreased facial width, fuller anterior part of the lower facial third and more pronounced middle forehead and root of the nose. Males favored a well-defined chin, flatter cheeks and zygomas, and more pronounced eyebrow ridges, nose and middle forehead. The findings of this study support the notion that self-perceived facial attractiveness is not only motivated by psychological traits, but objectively measured phenotypic traits also contribute significantly. The role of social stereotypes for facial attractiveness in modern society is also inferred and discussed.