Electric field control of magnetism provides a promising route towards ultralow power information storage and sensor technologies. The effects of magneto-ionic motion have been prominently featured in the modification of interface characteristics. Here, we demonstrate magnetoelectric coupling moderated by voltage-driven oxygen migration beyond the interface in relatively thick AlOx/GdOx/Co(15 nm) films. Oxygen migration and Co magnetization are quantitatively mapped with polarized neutron reflectometry under electro-thermal conditioning. The depth-resolved profiles uniquely identify interfacial and bulk behaviours and a semi-reversible control of the magnetization. Magnetometry measurements suggest changes in the microstructure which disrupt long-range ferromagnetic ordering, resulting in an additional magnetically soft phase. X-ray spectroscopy confirms changes in the Co oxidation state, but not in the Gd, suggesting that the GdOx transmits oxygen but does not source or sink it. These results together provide crucial insight into controlling magnetism via magneto-ionic motion, both at interfaces and throughout the bulk of the films.