This study examined the joint impact of experiencing both interparental violence and child physical maltreatment on young adults' self-esteem. It also tested the hypothesis of parental and peer relationship qualities as mediators in the relationship between childhood histories of family violence and adult self-esteem. Data were collected from a national probability sample of 1,924 college students in Taiwan. Research results demonstrated that experiencing both interparental violence and physical maltreatment during childhood have long-term and detrimental impact on adult self-esteem. This impact was statistically independent of other potential confounding factors. Moreover, participants experiencing dual violence during childhood reported lower self-esteem than those experiencing only one type of family violence or none at all. Male participants who experienced dual violence reported lower self-esteem than female participants who experienced dual violence. Further analyses revealed that parental and peer relationship qualities mediated the joint impact of interparental violence and physical maltreatment on adult self-esteem.