Stimulation of proteoglycan (PG) synthesis and deposition plays an important role in the pathophysiology of fibrosis and is an early and dominant feature of pulmonary fibrosis. Transforming growth factor-β1 (TGF-β1) is a major cytokine associated with fibrosis that induces excessive synthesis of matrix proteins, particularly PGs. Owing to the importance of PGs in matrix assembly and in mediating cytokine and growth factor signaling, a strategy based on the inhibition of PG synthesis may prevent excessive matrix PG deposition and attenuates profibrotic effects of TGF-β1 in lung fibroblasts. Here, we showed that 4-MU4-deoxy-β-D-xylopyranoside, a competitive inhibitor of β4-galactosyltransferase7, inhibited PG synthesis and secretion in a dose-dependent manner by decreasing the level of both chondroitin/dermatan- and heparin-sulfate PG in primary lung fibroblasts. Importantly, 4-MU4-deoxy-xyloside was able to counteract TGF-β1-induced synthesis of PGs, activation of fibroblast proliferation and fibroblast-myofibroblast differentiation. Mechanistically, 4-MU4-deoxy-xyloside treatment inhibited TGF-β1-induced activation of canonical Smads2/3 signaling pathway in lung primary fibroblasts. The knockdown of β4-galactosyltransferase7 mimicked 4-MU4-deoxy-xyloside effects, indicating selective inhibition of β4-galactosyltransferase7 by this compound. Collectively, this study reveals the anti-fibrotic activity of 4-MU4-deoxy-xyloside and indicates that inhibition of PG synthesis represents a novel strategy for the treatment of lung fibrosis.