We report on the electrical transport properties of Nb based Josephson junctions with Pt/Co[Formula: see text]B[Formula: see text]/Pt ferromagnetic barriers. The barriers exhibit perpendicular magnetic anisotropy, which has the main advantage for potential applications over magnetisation in-plane systems of not affecting the Fraunhofer response of the junction. In addition, we report that there is no magnetic dead layer at the Pt/Co[Formula: see text]B[Formula: see text] interfaces, allowing us to study barriers with ultra-thin Co[Formula: see text]B[Formula: see text]. In the junctions, we observe that the magnitude of the critical current oscillates with increasing thickness of the Co[Formula: see text]B[Formula: see text] strong ferromagnetic alloy layer. The oscillations are attributed to the ground state phase difference across the junctions being modified from zero to [Formula: see text]. The multiple oscillations in the thickness range [Formula: see text] nm suggests that we have access to the first zero-[Formula: see text] and [Formula: see text]-zero phase transitions. Our results fuel the development of low-temperature memory devices based on ferromagnetic Josephson junctions.