In a static magnetic field paramagnetic and nonmagnetic colloids immersed in a ferrofluid self-assemble into fluctuating colloidal flowers. Adsorption and desorption of nonmagnetic petals to larger paramagnetic cores and changes in the petal conformation around the paramagnetic core induce a fluctuating dynamics. We track the motion of colloidal petals on the paramagnetic core. Adsorption and desorption of petals occur on a larger time scale than the rotational diffusion of the petals. Magnetic dipole interactions split the motion of the petals into different modes of rotational diffusion. Modes of rotational diffusion that change the petal conformation are suppressed compared to the conformation invariant rotational diffusion of all petals. The suppression of higher modes of rotational diffusion results in a subdiffusive dynamics of the individual petals.