Vanadium-doped cobalt oxide materials have emerged as a promising class of catalysts for the oxygen evolution reaction. Previous studies suggest vanadium doping in crystalline Co spinel materials tunes the electronic structure and stabilizes surface intermediates. We report a CoV2O4 material that shows good activity for the oxygen evolution reaction. However, postmortem characterization of the catalyst material shows dissolution of vanadium resulting in an amorphous CoOx material, suggesting that this vanadium-free material, and not CoV2O4, is the active catalyst. This study highlights the importance of postmortem characterization prior to mechanistic and computational analysis for this class of materials.