We present the polarization dependence of strong asymmetric long period fiber gratings written on tapered fibers. We found that for off-resonance conditions the spectral response and the output mode strongly depend on the input state of polarization. We utilize this dependence to obtain a mode selective device and demonstrate radially polarized and azimuthally polarized fiber lasers based on these asymmetric long period fiber gratings.