We previously showed that facial expressions modulate functional MRI activity in the face-processing regions of the macaque monkey’s amygdala and inferior temporal (IT) cortex. Specifically, we showed that faces expressing emotion yield greater activation than neutral faces; we term this difference the “valence effect.” We hypothesized that amygdala lesions would disrupt the valence effect by eliminating the modulatory feedback from the amygdala to the IT cortex. We compared the valence effects within the IT cortex in monkeys with excitotoxic amygdala lesions (n = 3) with those in intact control animals (n = 3) using contrast agent-based functional MRI at 3 T. Images of four distinct monkey facial expressions--neutral, aggressive (open mouth threat), fearful (fear grin), and appeasing (lip smack)--were presented to the subjects in a blocked design. Our results showed that in monkeys with amygdala lesions the valence effects were strongly disrupted within the IT cortex, whereas face responsivity (neutral faces > scrambled faces) and face selectivity (neutral faces > non-face objects) were unaffected. Furthermore, sparing of the anterior amygdala led to intact valence effects in the anterior IT cortex (which included the anterior face-selective regions), whereas sparing of the posterior amygdala led to intact valence effects in the posterior IT cortex (which included the posterior face-selective regions). Overall, our data demonstrate that the feedback projections from the amygdala to the IT cortex mediate the valence effect found there. Moreover, these modulatory effects are consistent with an anterior-to-posterior gradient of projections, as suggested by classical tracer studies.