We describe a method to probe the spectral fluctuations of a transition over broad ranges of frequencies and timescales with the high spectral resolution of Fourier spectroscopy, and a temporal resolution as high as the excited state lifetime, even in the limit of very low photocounting rates. The method derives from a simple relation between the fluorescence spectral dynamics of a single radi-ating dipole and its fluorescence intensity correlations at the outputs of a continuously scanning Michelson interferometer. These findings define an approach to investigate the fast fluorescence spectral dynamics of single molecules and other faint light sources beyond the time-resolution capabilities of standard spectroscopy experiments.