Analysis of independent isothermal and linear heating creep and shear modulus measurements performed on bulk Pd- and Zr-based metallic glasses provides evidence that the relaxation of their viscoelastic and elastic properties is controlled by 'defects', which respond to stress and temperature similarly to dumbbell interstitials in simple crystalline metals.