For the first time the phenomenon of soliton rain is observed in a mode-locked fiber laser with all-polarization-maintaining (all-PM) architecture. The laser is mode-locked using a semiconductor saturable absorber mirror (SESAM) and operates in the all-normal dispersion (ANDi) regime. The operation state of the laser can be switched from dissipative soliton to soliton rain by simply raising the pump power, without any manipulation of the intracavity polarization state given that all components of the resonator are made of PM fibers. The soliton rain generated in the laser is self-starting and replicable, since it occurs in every individual operation of the laser as the pump power is increased to an approximately invariant value.