The distractor effect is an inhibition of saccades shortly after a sudden visual event. It has been explained both as an oculomotor reflex and as a manifestation of the orienting response. To clarify which explanation is more appropriate, we investigated a possible habituation of this effect. Visual and auditory distractors were presented at gaze-contingent intervals during the perception of meaningful pictures. Both reflexlike and modifiable components were present in the visual distractor effect, with latencies of about 110 and 180 ms, respectively. The influence of visual and auditory distractors on saccades preceded the earliest changes in cortical ERPs. Only for long-term habituation in the visual modality was a correlation with ERPs (N1) found.