Human multipotent mesenchymal stromal cells (hMSCs) are multipotent cells that, in the presence of appropriate stimuli, can differentiate into different lineages such as the osteogenic, chondrogenic, and adipogenic lineages. In the presence of ascorbic acid, MSCs secrete an extracellular matrix mainly composed of collagen type I. Here we assessed the potential role of endogenous collagen synthesis in hMSC differentiation and stem cell maintenance. We observed a sharp reduction in proliferation rate of hMSCs in the absence of ascorbic acid, concomitant with a reduction in osteogenesis in vitro and bone formation in vivo. In line with a positive role for collagen type I in osteogenesis, gene expression profiling of hMSCs cultured in the absence of ascorbic acid demonstrated increased expression of genes involved in adipogenesis and chondrogenesis and a reduction in expression of osteogenic genes. We also observed that matrix remodeling and anti-osteoclastogenic signals were high in the presence of ascorbic acid. The presence of collagen type I during the expansion phase of hMSCs did not affect their osteogenic and adipogenic differentiation potential. In conclusion, the collagenous matrix supports both proliferation and differentiation of osteogenic hMSCs but, on the other hand, presents signals stimulating matrix remodeling and inhibiting osteoclastogenesis.