We report the first experimental observation of strong suppression of matter-wave superradiance using blue-detuned pump light and demonstrate a pump-laser detuning asymmetry in the collective atomic recoil motion. In contrast to all previous theoretical frameworks, which predict that the process should be symmetric with respect to the sign of the detuning of the pump laser from the one-photon resonance, we find that for condensates the symmetry is broken. With high condensate densities and red-detuned pump light the distinctive multiorder, matter-wave scattering pattern is clearly visible, whereas with blue-detuned pump light superradiance is strongly suppressed. However, in the limit of a dilute atomic gas symmetry is restored.