Social and emotional processing uses neural systems involving structures ranging from the brain stem to the associational cortex. Neuroimaging research has attempted to identify abnormalities in components of these systems that would underlie the behavioral abnormalities seen in disorders of social and emotional processing, notably autism spectrum disorders, the focus of this review. However, the findings have been variable. The most replicated anatomic finding (a tendency toward large brains) is not modular, and metabolic imaging and functional imaging (although showing substantial atypicality in activation) are not consistent regarding specific anatomic sites. Moreover, autism spectrum disorder demonstrates substantial heterogeneity on multiple levels. Here evidence is marshaled from a review of neuroimaging data to support the claim that abnormalities in social and emotional processing on the autism spectrum are a consequence of systems disruptions in which the behaviors are a final common pathway and the focal findings can be variable, downstream of other pathogenetic mechanisms, and downstream of more pervasive abnormalities.