Animation creates a vivid, virtual world and expands the scope of human imagination. In this study, we investigated the time-courses of brain responses related to the evaluation of the attractiveness of cartoon faces using the event-related potential (ERP) technique. The results demonstrated that N170 amplitude was higher for attractive than for unattractive cartoon faces in males, while the opposite was found in females. Facial attractiveness notably modulated the late positive component (LPC), which might reflect the task-related process of aesthetic appraisal of beauty. The mean LPC amplitude in males was significantly higher for attractive cartoon faces than for unattractive faces, while the LPC amplitude in females did not significantly differ between attractive and unattractive cartoon faces. Moreover, the paint mode (computer graphics, gouache, and stick figure) modulated the early encoding of facial structures and the late evaluative process. The early modulation effect by paint mode may be related to the spatial frequency of the pictures. The processing speed and intensity in females were both higher than those in males. In conclusion, our study, for the first time, reported ERP modulation based on the assessment of cartoon facial attractiveness, suggesting the facilitated selection of attractiveness information at the early stage, and that the attentional enhancement of attractive faces at the late stage only exists in males. This suggests that men's brains are hard-wired to be sensitive to facial beauty, even in cartoons.