Myxococcus xanthus is a Gram-negative bacterium with a complex life cycle that includes vegetative swarming and fruiting-body formation. Social (S)-motility (coordinated movement of large cell groups) requires both type IV pili and fibrils (extracellular matrix material consisting of polysaccharides and protein). Little is known about the role of this extracellular matrix, or fibril material, in pilus-dependent motility. In this study, mutants lacking fibril material and, therefore, S-motility were found to be hyperpiliated. We demonstrated that addition of fibril material resulted in pilus retraction and rescued this phenotype. The fibril material was further examined to determine the component(s) that were responsible for triggering pilus retraction. Protein-free fibril material was found to be highly active in correcting hyperpiliation. However, the amine sugars present in hydrolyzed fibril material, e.g., glucosamine and N-acetylglucosamine (GlcNAc) had no effect on fibril(-) mutants, but, interestingly, cause hyperpiliation in wild-type cells. In contrast, chitin, a natural GlcNAc polymer, was found to restore pilus retraction in hyperpiliated mutants, indicating that a polysaccharide containing amine sugars is likely required for pilus retraction. These data suggest that the interaction of type IV pili with amine-containing polysaccharides on cell and slime-trail surfaces may trigger pilus retraction, resulting in S-motility and slime-trailing behaviors.