An analysis of infant mortality (based on 133,448 births) in two regions, Sundsvall and Skellefteå, in north-eastern Sweden during the nineteenth century shows that infant mortality was highly clustered with a relatively small number of families accounting for a large proportion of all infant deaths. Using logistic regression, two important factors were found to be associated with high-risk families: (i) a biological component evidenced by an over-representation of women who had experienced stillbirths, and (ii) a social component indicated by an increased risk among women who had remarried. The results strengthen the argument for using the family rather than the single child as the unit of analysis. The clustering of infant deaths points to the need to re-evaluate our interpretations of the causes of infant mortality in the past.