We demonstrate broadband supercontinuum generation in an all-normal dispersion polarization-maintaining photonic crystal fiber and report the observation of a cross-phase modulation instability sideband generated outside of the supercontinuum bandwidth. We demonstrate that this sideband is polarized on the slow axis and can be suppressed by pumping on the fiber's fast axis. We theoretically confirm and model this nonlinear process using phase-matching conditions and numerical simulations, obtaining good agreement with the measured data.