Intensity fluctuations in supercontinuum generation are studied in polarization-maintaining (PM) and non-PM all-normal dispersion tellurite photonic crystal fibers. Dispersive Fourier transformation is used to resolve the shot-to-shot spectra generated using 225-fs pump pulses at 1.55 μm, with experimental results well reproduced by vector and scalar numerical simulations. By comparing the relative intensity noise for the PM and non-PM cases, supported by simulations, we demonstrate the advantage of the polarization-maintaining property of the PM fibers in preserving low-noise dynamics. We associate the low-noise in the PM case with the suppression of polarization modulation instability.