Right temporal lobe structures are involved in face and facial expression processing and in mnestic functions. Face and facial expression memory was investigated in 15 patients with left (LTLE) and 18 patients with right (RTLE) temporal lobe epilepsy as well as 13 healthy controls. Pairs of pictures combining four faces and four emotions had to be matched according to face identity or facial expression. In the memory tasks, the two pictures of a pair were divided by a memory interval of 2000 milliseconds, whereas in the perception tasks (control condition) both pictures were presented simultaneously. RTLE patients had significantly lower scores than healthy controls in face memory. LTLE patients had significantly lower scores than healthy controls in face and facial expression memory. The data confirm impaired face memory in RTLE patients and show that LTLE patients display deficits in face as well as in facial expression memory. Results are discussed according to functional reorganization, memory strategies, perception performance, naming problems, and group characteristics.