Human ability to resolve temporal variation, or flicker, in the luminance (brightness) or chromaticity (color) of an image declines with increasing frequency and is limited, within the central visual field, to a critical flicker frequency of approximately 50 and 25 Hz, respectively. Much remains unknown about the neural filtering that underlies this frequency-dependent attenuation of flicker sensitivity, most notably the number of filtering stages involved and their neural loci. Here we use the process of flicker adaptation, by which an observer's flicker sensitivity is attenuated after prolonged exposure to flickering lights, as a functional landmark. We show that flicker adaptation is more sensitive to high temporal frequencies than is conscious perception and that prolonged exposure to invisible flicker of either luminance or chromaticity, at frequencies above the respective critical flicker frequency, can compromise our visual sensitivity. This suggests that multiple filtering stages, distributed across retinal and cortical loci that straddle the locus for flicker adaptation, are involved in the neural filtering of high temporal frequencies by the human visual system.