Humans constantly encounter new microbes, but few become long-term residents of the adult gut microbiome. Classical theories predict that colonization is determined by the availability of open niches, but it remains unclear whether other ecological barriers limit commensal colonization in natural settings. To disentangle these effects, we used a controlled perturbation with the antibiotic ciprofloxacin to investigate the dynamics of gut microbiome transmission in 22 households of healthy, cohabiting adults. Colonization was rare in three-quarters of antibiotic-taking subjects, whose resident strains rapidly recovered in the week after antibiotics ended. In contrast, the remaining antibiotic-taking subjects exhibited lasting responses, with extensive species losses and transient expansions of potential opportunistic pathogens. These subjects experienced elevated rates of commensal colonization, but only after long delays: many new colonizers underwent sudden, correlated expansions months after the antibiotic perturbation. Furthermore, strains that had previously transmitted between cohabiting partners rarely recolonized after antibiotic disruptions, showing that colonization displays substantial historical contingency. This work demonstrates that there remain substantial ecological barriers to colonization even after major microbiome disruptions, suggesting that dispersal interactions and priority effects limit the pace of community change.