Matrix mineralization can be divided into physiological mineralization and pathological mineralization. There is a consensus among existing studies that matrix vesicles (MVs) are the starting sites of bone mineralization, and each component of MVs serves a certain function in mineralization. In addition, ectopic MVs pathologically promote undesired calcification, the primary focus of which is the promotion of vascular calcification. However, the specific mechanisms of the actions of MVs in bone-vascular axis cross-talk have not been fully elucidated. This review summarizes the latest research in this field and explores the roles of MVs in the bone-vascular axis with the aim of generating new ideas for the prevention and treatment of vascular calcification and bone metabolic disease.