In this work, we conduct experimental investigations of transverse mode instabilities (TMI) in a large mode area ultra-low numerical aperture polarization maintaining fiber amplifier. This fiber is few mode in the slow-axis (conventional operation mode), but single mode in the fast-axis. We test the stability of the output beam by changing the input polarization angle and systematically investigate the transverse mode instability threshold in the two principal polarization axes. The lowest TMI threshold at 300 W was found when the input polarization angle was aligned parallel to the slow-axis. Detuning the input polarization angle from the slow-axis led to increased TMI thresholds. For input polarization angle of 90° (parallel to the fast-axis), the output signal was stable up to 475 W and further scaling was limited by the available pump power. However, for fast-axis operation a lower polarization ratio compared to slow-axis operation was observed as well as an unexpected static energy transfer from the fast-axis into the slow-axis above 400 W.