The extracellular matrix (ECM) is a highly dynamic network constantly remodeled by a fine-tuned protein formation and degradation balance. Matrix metalloproteinases (MMPs) constitute key orchestrators of ECM degradation. Their activity is controlled by tissue inhibitors of metalloproteinases (TIMPs) and glycosaminoglycans (GAG). Here, we investigated the molecular interplay of MMP2 with different GAG (chondroitin sulfate, hyaluronan (HA), sulfated hyaluronan (SH) and heparin (HE)) and the impact of GAG on MMP2/TIMP3 complex formation using in vitro-experiments with human bone marrow stromal cells, in silico docking and molecular dynamics simulations. SH and HE influenced MMP2 and TIMP3 protein levels and MMP2 activity. Only SH supported the alignment of both proteins in fibrillar-like structures, which, based on our molecular models, would be due to a stabilization of the interactions between MMP2-hemopexin domain and TIMP3-C-terminal tail. Dependent on the temporal sequential order in which the final ternary complex was formed, our models indicated that SH and HA can affect TIMP3-induced MMP2 inhibition through precluding or supporting their interactions, respectively. Our combined experimental and theoretical approach provides valuable new insights on how GAG interfere with MMP2 activity and MMP2/TIMP3 complex formation. The results obtained evidence GAG as promising molecules for fine-balanced intervention of ECM remodeling.