Antibodies of the secretory IgA (SIgA) class comprise the first line of antigen-specific immune defense, preventing access of commensal and pathogenic microorganisms and their secreted products into the body proper. In addition to preventing infection, SIgA shapes the composition of the gut microbiome. SIgA is transported across intestinal epithelial cells into gut secretions by the polymeric immunoglobulin receptor (pIgR). The epithelial surface is protected by a thick network of mucus, which is composed of a dense, sterile inner layer and a loose outer layer that is colonized by commensal bacteria. Immunofluorescence microscopy of mouse and human colon tissues demonstrated that the SIgA co-localizes with gut bacteria in the outer mucus layer. Using mice genetically deficient for pIgR and/or mucin-2 (Muc2, the major glycoprotein of intestinal mucus), we found that Muc2 but not SIgA was necessary for excluding gut bacteria from the inner mucus layer in the colon. Our findings support a model whereby SIgA is anchored in the outer layer of colonic mucus through combined interactions with mucin proteins and gut bacteria, thus providing immune protection against pathogens while maintaining a mutually beneficial relationship with commensals.