We present mid-infrared (MIR) supercontinuum generation in polarization-maintained ZBLAN fibers pumped by 2 µm femtosecond pulses from a Tm:YAP regenerative amplifier. A stable supercontinuum that spreads from 380 nm to 4 µm was generated by coupling only 0.5 µJ pulse energy into an elliptical core ZBLAN fiber. The supercontinuum was characterized using cross-correlation frequency-resolved optical gating (XFROG). The complex structure of the XFROG trace due to the pulse-to-pulse spectrum instability have been fixed by reducing the length of the applied fibers or improving the quality of the incident pulse spectrum.