Microbial communities inhabiting the human body, collectively called the microbiome, are critical modulators of immunity. This notion is underpinned by associations between changes in the microbiome and particular autoimmune disorders. Specifically, in rheumatoid arthritis, one of the most frequently occurring autoimmune disorders worldwide, changes in the oral and gut microbiomes have been implicated in the loss of tolerance against self-antigens and in increased inflammatory events promoting the damage of joints. In the present review, we highlight recently gained insights in the roles of microbes in the etiology of rheumatoid arthritis. In addition, we address important immunomodulatory processes, including biofilm formation and neutrophil function, which have been implicated in host-microbe interactions relevant for rheumatoid arthritis. Lastly, we present recent advances in the development and evaluation of emerging microbiome-based therapeutic approaches. Altogether, we conclude that the key to uncovering the etiopathogenesis of rheumatoid arthritis will lie in the immunomodulatory functions of the oral and gut microbiomes.