Social behavior can shape the local population genetic structure of mammals. Group living can increase pairwise genetic relatedness of mammals at a local level but differentiate the genetic structure at a population level through offspring philopatry and nonrandom mating. Our study aimed to test the hypothesis that social groups of Mongolian gerbils (Meriones unguiculatus) would consist of genetically related individuals due to offspring philopatry and would have distinct genetic structures because of restricted gene flow among social groups and nonrandom mating. We genotyped 327 wild gerbils, live captured from 28 social groups in Inner Mongolia, China, using nine microsatellite loci. The within-group pairwise genetic relatedness coefficient averaged 0.28 ± 0.14 (standard deviation), whereas the average pairwise genetic relatedness coefficient of the whole gerbil population was 0.0 ± 0.2. Additionally, the value of the global F statistic (F(st)) was 0.21, suggesting a substantial genetic differentiation among social groups of Mongolian gerbils. The Bayesian clustering divided the 327 gerbils into 23 distinct genetic clusters. Therefore, our results show that high within-group genetic relatedness and among-group genetic differentiation are the genetic consequences of group living in social mammals because of restricted gene flow, female philopatry, and nonrandom mating within social groups.