We demonstrated an ultra-low-noise polarization-maintaining (PM) single-frequency fiber laser at 2 µm. Both relative intensity noise (RIN) and frequency noise were improved by suppressing the pump source RIN using feedback control. After a two-stage Tm3+-doped PM fiber amplifier, the output power reached about 5 W, and the amplifier did not introduce any observable extra frequency noise. The frequency noise was less than 100Hz/Hz above 13 Hz, which is comparable to the frequency noise of a typical seed laser of the Advanced LIGO high-power laser. The central wavelength was measured to be 1990.25 nm, with a polarization extinction ratio above 24 dB.