In interferometry, reaching a high signal-to-noise ratio at low frequencies can be challenging when the additive noise is nonstationary. Although this problem is typically solved by inserting a frequency shifter into one of the arms, in some cases, the interferometer cannot or should not be modified in this way. This Letter presents an alternative solution, based on external serrodyne frequency modulation, which is comparable to the typical approach in terms of complexity and performance yet does not require the modification of a passive interferometer. We demonstrate a prototype that achieves frequency shifting at 500 kHz with 89% power efficiency, leading to the wideband suppression of low-frequency additive noise by more than 19 dB. This enables a fully passive measurement of the thermoconductive noise of a 100 m single-mode fiber.