Carbon black waste, an oil refinery waste, contains a high concentration of vanadium(V) leftover from the processing of crude oil. For the sake of environmental sustainability, it is therefore of interest to recover the vanadium as useful products instead of disposing of it. In this work, V was recovered in the form of vanadium-based metal-organic frameworks (V-MOFs) via a novel pathway by using the leaching solution of carbon black waste instead of commercially available vanadium chemicals. Two different types of V-MOFs with high levels of crystallinity and phase purity were fabricated in very high yields (>98%) based on a coordination modulation method. The V-MOFs exhibited well-defined and controlled shapes such as nanofibers (length: > 10 μm) and nanorods (length: ∼270 nm). Furthermore, the V-MOFs showed high catalytic activities for the oxidation of benzyl alcohol to benzaldehyde, indicating the strong potential of the waste-derived V-MOFs in catalysis applications. Overall, our work offers a green synthesis pathway for the preparation of V-MOFs by using heavy metals of industrial waste as the metal source.