Previous research showed that viewing symmetrically distorted faces for a few minutes causes undistorted faces to appear distorted in the opposite manner (face-distortion aftereffect, FDAE). Three experiments with 90 observers demonstrated that adaptation to an asymmetrically distorted face also causes FDAE, but does not affect perception of its mirror image. The results suggested the FDAE occurs at the level of visual processing where distinct neural populations respond to a non-frontal facial image and its mirror image. Unlike most aftereffects, this FDAE lasts at least 30 min. Spatial and temporal characteristics of the FDAE and its relevance to portrait drawing and painting are discussed.