Visual attention can be allocated to locations or objects, leading to enhanced processing of information at the specific location (space-based effects) or specific object (object-based effects). Previous studies have observed object-based effects to be smaller and less robust than space-based effects, with large individual differences in their temporal occurrence. Studies on space- and object-based effects are often based on a two-rectangle paradigm in which targets appear at cued locations more often than uncued locations. It is, however, unclear whether and how the target's spatial probability affects the temporal occurrence of these effects. In three experiments with different cue validities (80%, 50% and 33%), we systematically changed the interval between the cue and the target from 50 to 600 ms. On a group level and for individuals, we examined how cue validity affects the occurrence of object- and space-based effects. We observed that the magnitude and the prevalence of space-based effects heavily decreased with reduced cue validity. Object-based effects became even more sparse and turned increasingly negative with decreasing cue validity, representing a different-object rather than a same-object advantage. These findings indicate that changes in cue-validity affect both space- and object-based effects, but it does not account for the low prevalence and magnitude of object-based effects.