The role of T and B lymphocytes, as antigen-specific effector immune cells playing an essential role in host defense against pathogens, is well recognized. Over the last decade, these lymphocytes have however also emerged as key regulatory components of the immune system, able to prevent various immunopathologies due to excessive inflammatory responses. These regulatory T (Treg) and B (Breg) cells, endowed with anti-inflammatory properties, operate via both antigen-specific and non-specific mechanisms and mainly develop during chronic infections. Here, we discuss the role of Treg and Breg lymphocytes in various infectious diseases, in experimental murine models and in human.