Facial expressions are powerful non-verbal displays of emotion which signal valence information to others and constitute an important communicative element in social interaction. Six basic emotional expressions (fear, disgust, anger, surprise, happiness, and sadness) have been shown to be universal in their performance and perception. Recently, a growing number of clinical and functional imaging studies have aimed at identifying partly dissociable neural subsystems for recognizing basic emotions. Convincing results have been obtained for fearful and disgusted facial expressions only. Empirical evidence for a specialized neural representation of anger, surprise, sadness, or happiness is more limited, primarily due to lack of clinical cases with selective impairments in recognizing these emotions. In functional imaging research, the detection of dissociable neural responses requires direct comparisons of signal changes associated with the perception of different emotions, which are often not provided. Only recently has evidence been obtained that the recruitment of emotion-specific neural subsystems may be closely linked to characteristic facial features of single expressions such as the eye region for fearful faces. Investigations into the neural systems underlying the processing of such diagnostic cues for each of the six basic emotions may be helpful to further elucidate their neural representation.