Gaze following is a fundamental ability that plays an important role in human social function. However, the link between these two processes remains elusive. On the one hand, typically developing persons show robust gaze following in laboratory cuing tasks. On the other hand, investigations with individuals with autism suggest that reduced social competence in this population may partly reflect an atypical access to social information through attending to perceptual changes that normally accompany gaze shifts, like luminance or motion transients. Here we investigated if gaze cuing in typically developing individuals was modulated by similar task-irrelevant perceptual changes. In Experiment 1, a social gaze cue was presented with or without a luminance change. In Experiment 2, a social gaze cue was presented together with a motion cue. Both experiments indicated reduced magnitudes of gaze cuing in persons with low social competence on trials containing an irrelevant perceptual change. This suggests that similarly to individuals with autism, typically developing persons with low social competence also utilize idiosyncratic perceptual changes in the environment to access social content, revealing strong links between basic gaze following abilities and a range of social competence within typical individuals.