As an important online information retaining and processing function, working memory plays critical roles in many other cognitive functions. Several long-term factors, such as age, addiction and diseases, have been affirmed to impair working memory, but whether or how the short-term factors, like painful stimuli or emotions, regulate the human working memory ability is not well explored. Here we investigated the influences of empathic pain on upcoming working memory and existing working memory, by presenting human subjects with the pictures depicting painful or neutral scene. After separating the subjects into two groups, the more empathic group and relatively indifferent group, according to a well-accepted questionnaire (the Interpersonal Reactivity Index (IRI)), the modulatory effect emerged. Empathic pain might exerted either a facilitating effect or an impairing effect, which was closely correlated with the personal empathy skills. Meanwhile, different aspects of subjects' empathy traits exerted distinct effects, and female subjects were more vulnerable than male subjects. Present study reveals a new modulatory manner of the working memory, via empathy skill-dependent painful experience.