The negative consequences of habitat fragmentation for plant communities have been documented in many regions of the world. In some fragmented habitats, livestock grazing has been proposed to be a dispersal mechanism reducing isolation between fragments. In others, grazing acts together with fragmentation in a way that increases habitat degradation. Iberian gypsum plant communities have been grazed and fragmented by agricultural practices for centuries. Although their conservation is considered a priority by the European Community, the effects of fragmentation on gypsum plant communities and the possible role of livestock grazing remain unknown. In addition, a substantial proportion of plant species growing in gypsum environments are gypsum specialists. They could be particularly affected by fragmentation, as was found for other habitat specialists (i.e., serpentine and calcareous specialists). In this study (1) we investigated the effect of fragmentation and grazing on gypsum plant community composition (species and life-forms), and (2) we tested to see if gypsum specialists were differently affected by fragmentation and grazing than habitat generalists. A vegetation survey was conducted in the largest gypsum outcrop of Europe (Middle Ebro Valley, northeast Spain). Fragmented and continuous sites in grazed and ungrazed areas were compared. Measurements related to species and composition of life-forms were contrasted first for the whole gypsum plant community and then specifically for the gypsum specialists. In the whole community, our results showed lower plant species diversity in fragmented sites, mainly due to the larger dominance of species more tolerant to fragmented habitat conditions. With livestock grazing, the plant species richness and the similarity in plant species composition between remnants was larger, suggesting that animals were acting as dispersal agents between fragments. As expected, gypsum specialists were less abundant in fragmented areas, and grazing led to the disappearance of the rare gypsum specialist Campanula fastigiata. According to our results, conservation strategies for gypsum plant communities in human-dominated landscapes should consider that fragmentation and grazing modify plant community composition affecting gypsum specialists in particular.